Senior Data Engineer
2 weeks ago
Job Purpose : We are seeking a highly skilled ETL Data Engineer to re-engineer our existing data pipelines to extract data from a new data source (PostgreSQL / CURA system) instead of the current Microsoft SQL Server (CRM persistence store), while preserving the existing load patterns to Elasticsearch and MongoDB. The engineer will ensure this migration has zero impact on data quality, system performance, or end-user experience. Key Responsibilities : - Analyze existing ETL pipelines and their dependencies on Microsoft SQL Server as source systems. - Design and implement modifications to repoint ETL extractions from PostgreSQL (CURA) while preserving the current transformations and load logic into Elasticsearch and MongoDB. - Ensure end-to-end data integrity, quality, and freshness remain unaffected after the source switch. - Write efficient and optimized SQL queries to extract data from the new source. - Conduct performance testing to confirm no degradation of pipeline throughput or latency in production. - Work closely with DevOps and platform teams to containerize, orchestrate, and deploy the updated ETLs using Docker and Kubernetes. - Monitor post-deployment performance and handle any production issues proactively. - Document design, code, data mappings, and operational runbooks. Required Skills and Qualifications : - Strong experience building and maintaining large-scale distributed data systems.- Expert-level proficiency in Python, especially data analysis/manipulation libraries like pandas, NumPy, and Polars. - Advanced SQL development skills with proven experience in performance optimization. - Working knowledge of Docker and Kubernetes. - Familiarity with Elasticsearch and MongoDB as data stores. - Experience working in production environments with mission-critical systems.
-
Data Senior Engineer
1 day ago
Noida, Uttar Pradesh, India NTT DATA North America Full time ₹ 9,00,000 - ₹ 12,00,000 per yearReq ID:345995NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Senior Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Job Duties: As a data analyst you will...
-
Senior Data Engineer
6 days ago
Noida, Uttar Pradesh, India GlobalLogic Full time ₹ 8,00,000 - ₹ 24,00,000 per yearCompany DescriptionGlobalLogic, a Hitachi Group company, is a trusted partner in design, data, and digital engineering for the world's largest and most innovative companies. Since our inception in 2000, we have been at the forefront of the digital revolution, helping to create some of the most widely used digital products and experiences. Our purpose is to...
-
Senior Data Engineer
7 days ago
Noida, India Tata Consultancy Services Full timeTCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply. Senior Data Engineer Location: Noida/Bhubaneswar or Kochi Exp. Needed: Min 8 to 12 years of exp. Must Have Skills :: Data Engineer, Apache Spark, ScalaRole Summary: We're...
-
Senior Data Engineer
6 days ago
Noida, India Tata Consultancy Services Full timeTCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply. Senior Data Engineer Location: Noida/Bhubaneswar or Kochi Exp. Needed: Min 8 to 12 years of exp. Must Have Skills :: Data Engineer, Apache Spark, Scala Role Summary: We're...
-
Senior Data Engineer
6 days ago
Noida, India Tata Consultancy Services Full timeTCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply. Senior Data Engineer Location: Noida/Bhubaneswar or Kochi Exp. Needed: Min 8 to 12 years of exp. Must Have Skills :: Data Engineer, Apache Spark, Scala Role Summary: We're...
-
Senior Data Engineer
6 days ago
Noida, India Tata Consultancy Services Full timeTCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply. Senior Data Engineer Location: Noida/Bhubaneswar or Kochi Exp. Needed: Min 8 to 12 years of exp. Must Have Skills :: Data Engineer, Apache Spark, ScalaRole Summary: We're...
-
Senior Data Engineer
6 days ago
Noida, India Tata Consultancy Services Full timeTCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply. Senior Data Engineer Location: Noida/Bhubaneswar or Kochi Exp. Needed: Min 8 to 12 years of exp. Must Have Skills :: Data Engineer, Apache Spark, Scala Role Summary: We're...
-
Senior Data Engineer
6 days ago
Noida, India Tata Consultancy Services Full timeTCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply. Senior Data Engineer Location: Noida/Bhubaneswar or Kochi Exp. Needed: Min 8 to 12 years of exp. Must Have Skills :: Data Engineer, Apache Spark, ScalaRole Summary: We're...
-
Senior Data Engineer
5 days ago
Noida, India Tata Consultancy Services Full timeTCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply.Senior Data EngineerLocation: Noida/Bhubaneswar or KochiExp. Needed: Min 8 to 12 years of exp.Must Have Skills :: Data Engineer, Apache Spark, ScalaRole Summary:We're seeking a...
-
Senior Data Engineer
6 days ago
Noida, India Tata Consultancy Services Full timeTCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply.Senior Data EngineerLocation: Noida/Bhubaneswar or KochiExp. Needed: Min 8 to 12 years of exp.Must Have Skills :: Data Engineer, Apache Spark, ScalaRole Summary:We're seeking a...
