Senior Data Engineer

3 weeks ago

delhi, India EXL Full time
Responsibilities:
Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
Create the data integration and data diagram documentation.
Lead the data validation, UAT and regression test for new data asset creation.
Create and maintain data models, including schema design and optimization.
Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.
Qualifications and Skills:
Strong knowledge on Python and Pyspark
Expectation is to have ability to write Pyspark scripts for developing data workflows.
Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum
Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.
Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.
Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.
Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.
Expectation is to have strong problem-solving and troubleshooting skills.
Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.
Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.
5-7 years of experience in Data Engineer.
Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.
Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks.
Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.

  • Operations Specialist

    1 month ago

    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    7 days ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    7 days ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Senior Data Engineer

    3 weeks ago

    delhi, India RoundCircle Full time

    Round Circle is a leading technology company dedicated to leveraging data-driven insights to fuel innovation and drive business growth. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure,...

  • Senior Data Engineer

    7 days ago

    Delhi, Delhi, India RoundCircle Full time

    Round Circle is a leading technology company dedicated to leveraging data-driven insights to fuel innovation and drive business growth. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure,...

  • Senior Data Engineer

    7 days ago

    Delhi, Delhi, India hunterAI Full time

    Company DescriptionJoin hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    2 months ago

    delhi, India hunterAI Full time

    Company DescriptionJoin hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    1 month ago

    Delhi, India PrimEra Medical Technologies Full time

    Job Description: Senior Data EngineerAbout PrimEra:PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact.Position Overview:We are seeking a highly skilled Senior...

  • Senior Data Engineer

    7 days ago

    Delhi, Delhi, India PrimEra Medical Technologies Full time

    Job Description: Senior Data EngineerAbout PrimEra:PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact.Position Overview:We are seeking a highly skilled Senior...

  • Senior Lead Engineer

    7 days ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID:283992NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with Enterprise...

  • Senior Lead Engineer

    7 days ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:282068NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."Strongly prefer...

  • Senior Lead Engineer

    3 weeks ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with Enterprise Integration...

  • Senior Lead Engineer

    3 weeks ago

    Delhi, India NTT DATA Services Full time

    Req ID: 283992  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN). Work closely...

  • Senior Lead Engineer

    3 weeks ago

    Delhi, India NTT DATA Services Full time

    Req ID: 283992  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN). Work closely...

  • Senior Data Engineer

    2 months ago

    Delhi, India Jeavio Full time

    We are an US based Venture Service Company. We focus on partnering with product companies to help them develop their technology products and bring them to the market. We have established state-of-the-art software development centers in Baroda.We have an exciting opportunity for the role of aSenior Data Engineerwith our company. We are looking for...

  • Senior Data Engineer

    3 weeks ago

    Delhi, India Next-Link Full time

    Job DescriptionWe are searching for a talentedSenior Data Engineerto join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical solution...

  • Senior Data Engineer

    1 month ago

    Delhi, India Next-Link Full time

    Job DescriptionWe are searching for a talentedSenior Data Engineerto join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical solution...

  • Senior Data Engineer

    3 days ago

    Delhi, India True Tech Professionals Full time

    Lead Data Engineer Location: Remote Gurgaon (Office visit once in a while as and when required) Experience: 7+ years Are you passionate about leveraging data to drive business decisions? Do you thrive in a collaborative environment where your expertise in data engineering can make a significant impact? If so, we're looking for you to join our team as a...

  • Senior Data Engineer

    3 weeks ago

    Delhi, India OTSI Full time

    Job DescriptionObject Technology Solutions, Inc(OTSI)has an immediate opening for a Senior Data Engineer.Senior Data Engineer (Irving, Tx)JOB DESCRIPTION:• Analyze and understanddata sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and...

  • Senior Data Engineer

    4 weeks ago

    Delhi, India OTSI Full time

    Job DescriptionObject Technology Solutions, Inc(OTSI)has an immediate opening for a Senior Data Engineer.Senior Data Engineer (Irving, Tx)JOB DESCRIPTION:• Analyze and understanddata sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and...