We are looking for Senior Data Engineer who is passionate about managing large amount of data, eager to learn and accept challenges, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you
Roles and Responsibilities:
- Experience working with Azure service for data ETL
- 3+ years of Experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions
- Experience in designing data models effectively to manage optimal performance.
- Designing, developing, monitoring and maintaining end-to-end data pipelines
- Should have extensive working knowledge of handling TBs of data in data ingestion, data processing and pipeline creation.
- Experience with designing and implementing complex high throughput distributed batch and/or real-time solutions using one of ADF, Databricks, Apache Kafka, and Apache Airflow
- Extensive hands-on experience implementing data migration, data processing, ETL or ELT pipeline development and monitoring.
- Strong programming skills in Python, SQL skills for data analysis and reporting
- Should have knowledge of anyone Data Warehouse like Synapse, Snowflake, Redshift or BigQuery
- Proven ability to work independently, mentor peers and meet tight deadlines
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Postgres, SQL Server, MySQL
- Should have knowledge of NoSQL Database like MongoDB, CosmosDB, Cassandra, GraphDB
- Experience in write complex query, function, store procedure, execution plan, Performance Tuning and Query Optimization, Indexing, Partitioning and Denormalization
- Should be well versed with migration strategies by manual and automated processes
- Excellent interpersonal, communication skills (both verbal and written), and ability to interact effectively
- Should attend client call independently
- Azure certification would be big plus