Senior Data Engineer
1 day ago
About the Role:
We are seeking a Senior Data Engineer to drive the development of our next-generation Data Lakehouse architecture.
You will be responsible for designing, building, and optimizing massive-scale, low-latency data pipelines that support real-time analytics and Machine Learning applications.
Key Responsibilities:
Design and build highly optimized, production-grade ETL/ELT pipelines using Apache Spark (PySpark/Scala) to process petabytes of data.
Architect and manage the Data Lakehouse using open-source technologies like Delta Lake or Apache Hudi for ACID transactions and data quality.
Integrate and process real-time data streams using technologies such as Apache Kafka or Kinesis.
Implement automated data quality checks, monitoring, and lineage tracking across all data products.
Collaborate with the infrastructure team to automate data platform deployment and scaling on the cloud (AWS EMR/Glue or Databricks) using Terraform.
Optimize data warehousing and querying performance in platforms like Snowflake or Google BigQuery.
Technical Skills Required:
Expert proficiency and tuning experience with Apache Spark (PySpark or Scala).
Mandatory experience with Data Lakehouse technologies (Delta Lake, Iceberg, or Hudi).
Strong experience with at least one public cloud data platform (AWS, GCP, or Azure).
Solid knowledge of data modeling (Dimensional, Data Vault) and advanced SQL.
Experience with workflow orchestration tools like Apache Airflow or Prefect
-
Senior Data Engineer
2 days ago
Delhi, NCR, India MchooversPacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per yearTitle: Senior Data Engineer (IDMC-CDI)Primary Skills: IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 8-15 yearsShift Timing: Open to work in EST shift (5PM to 2AM IST)About UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various...
-
Senior Data Engineer
1 week ago
Delhi, India Eucloid Data Solutions Full timeJob Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior DevOps Engineer
1 week ago
Delhi, India Crest Data Full timeCompany Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL : Location- AhmedabadJob DescriptionWe are...
-
Senior DevOps Engineer
1 week ago
Delhi, India Crest Data Full timeCompany Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL : Location- AhmedabadJob DescriptionWe are...
-
Senior DevOps Engineer
1 week ago
Delhi, India Crest Data Full timeCompany Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL : Location - AhmedabadJob DescriptionWe are...
-
Senior devops engineer
3 days ago
Delhi, India Crest Data Full timeCompany Overview:Crest Data is the global leading provider of Data Analytics, Security, Dev Ops, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL : Location - AhmedabadJob DescriptionWe...
-
Senior Data Engineer
1 day ago
Delhi, NCR, India Zorba Consulting Full time ₹ 8,00,000 - ₹ 12,00,000 per yearAbout the Job :We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and...
-
Senior Data Engineer
3 days ago
New Delhi, India Eucloid Data Solutions Full timeJob Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
▷ (Only 24h Left) Senior DevOps Engineer
1 week ago
Delhi, India Crest Data Full timeCompany Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : http://www.crestdata.ai Job Location -...
-
Senior data engineer
3 weeks ago
Delhi, India AIQU Full timeWe are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...
