Data Engineer

1 month ago

Gurgaon, India Corning Full time

Requisition Number: 62779

 

Corning is vital to progress – in the industries we help shape and in the world we share.

We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts, works, learns, and lives.

Our sustained investment in research, development, and invention means we’re always ready to solve the toughest challenges alongside our customers. 

As a leading developer, manufacturer, and global supplier of scientific laboratory products for 100 years, Corning’s Life Sciences segment collaborates with researchers seeking new approaches to increase efficiencies, reduce costs and compress timelines in the drug discovery process. Using unique expertise in the fields of materials science, surface science, optics, biochemistry and biology, the segment provides innovative solutions that improve productivity and enable breakthrough discoveries.

 

 

Scope of Position:

The Data Engineer, Analytics will be responsible for the architecture, implementation and governance of Corning Life Sciences’ data lake supporting the division’s centralized analytics platform. You will be joining an exciting, newly formed analytics center of excellence for the Corning Life Science division. Our mission is to add value to the business by utilizing our expertise in data engineering, statistics, and machine learning to identify and address the biggest opportunities to grow our $1B+ business. This position is located in our Gurugram, India office.

 

Required Education and Years of Experience:

  • Bachelor's degree in Computer Science, Engineering, or related discipline
  • 3+ years of experience in data engineering roles, developing and maintaining production ETL and ELT pipelines for data warehousing, on-premise or in cloud-based data lake environments
  • 1+ years of demonstrated production programming proficiency in at least one scripting language such as Python
  • 1+ years of experience developing data ingestion pipelines using Apache Spark APIs such as pySpark

 

Required Skills

  • Technical familiarity with Apache Spark architecture, S3, parquet and Delta Lake architecture, technologies, and tools
  • Experience with agile software development & continuous integration + continuous deployment methodologies along with supporting tools such as Git (Gitlab),and  Jira
  • Experience with established enterprise ETL and integration tools such as Informatica, Mulesoft
  • Proven success in collaborating with other technical and non-technical teams to collect and understand requirements, and describe data modeling decisions within business context
  • Excellent organizational skills including prioritization of multiple concurrent projects while still delivering timely and accurate results

 

Day to Day Responsibilities:

  • Design, test, deploy and maintain production big-data ingestion pipelines using agile software development and continuous delivery and/or continuous deployment (CI/CD) practices, collaborating closely with the advanced analytics platform team
  • Work with cross-organizational data source teams to define data ingestion requirements for structured, unstructured and semi-structured data, pilot their implementation, and ensure user acceptance
  • Define and implement automated validation and profiling capabilities needed to ensure reliable data delivery, using agile software development and CI/CD practices
  • Work with data source teams, domain experts, analysts and data scientists to define and develop data transformation, cleansing and data enrichment processes
  • Actively participate in code reviews and technical information sharing with your team members and the broader software engineering community at Corning
  • Develop and implement data governance processes to support a robust and well documented data lake environment
  • Stay up to date with industry standards and technological advancements that will improve the quality, productivity and performance of your work
  • Provide support in a DevOps environment to monitor overall system performance

 

Desired Experience / Qualifications / Skills:

  • Master’s degree in Computer Science, Engineering, or related discipline
  • Familiarity with Oracle, Microsoft SQL Server, SSIS, SSRS data technologies
  • Familiarity with the Databricks Platform and notebook environments
  • Familiarity with reporting and analysis tools such as PowerBI, Tableau, or SAS JMP

  • Data Engineer

    2 months ago

    Gurgaon, Haryana, India NatWest Digital X Full time

    Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and...

  • DATA Engineer

    2 weeks ago

    Gurgaon, Haryana, India Leadsky Full time

    Position: Data Engineer Location: Gurgaon Position Summary: In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. Your Role Responsibilities and Duties: Monitor and...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Saarthee Full time

    Position Summary:In the Data Engineer role, you will be involved in data retrieval from various systems, processing and cleansing data, and building automated data pipelines for analytics and insights.Your Role Responsibilities and Duties:Monitor and troubleshoot operational or data issues in the data source/lake for updated versions.Create and maintain...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB's target state Marketing Platforms.You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for both...

  • Data Engineer

    2 weeks ago

    Gurgaon, India GlobalLogic Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer with expertise in Apache Spark, Scala, and Java to join our dynamic team. The ideal candidate will have a strong background in data engineering, a deep understanding of big data technologies, and the ability to design and implement scalable data processing solutions.Job...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India True Tech Professionals Private Limited Full time

    Location : Gurgaon (Hybrid Mode)Experience : 5 years and above. (Less than 5 years will not be considered)Immediate Joiners Preferred (Notice Period: 7 to 10 days)We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena,...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Expedify Full time

    Data Engineer - Job Description Exp - min 1 year Salary Budget- 4-6 lpa Overview is looking for an intelligent and detail-oriented Data Engineer, to join our ever expanding team of data engineering and analytics. The hire will be responsible for building and optimizing our data pipeline architecture, optimizing data flow and suggesting the right set of...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Teleparty Full time

    Teleparty is hiring Data Engineers Join Teleparty, a premium remote entertainment service leading the charge in making social TV a global cultural phenomenon bigger than the movies. With over 10 million streamers who have installed our Netflix focused browser extension - Teleparty, we operate the largest social TV service in the world for millions of...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India AHEAD Full time

    AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises deliver on the promise of digital transformation.At AHEAD, we prioritize creating a culture of belonging, where all perspectives and voices are represented, valued, respected, and heard. We...

  • Data Engineer

    1 month ago

    gurgaon, India GlobalLogic Full time

    Job Description:We are seeking a highly skilled Data Engineer with expertise in Apache Spark,Scala, and Java to join our dynamic team. The ideal candidate will have a strongbackground in data engineering, a deep understanding of big data technologies,and the ability to design and implement scalable data processing solutions.Responsibilities:• Data Pipeline...

  • Data Engineer

    4 weeks ago

    gurgaon, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data Engineer

    2 weeks ago

    gurgaon, India hiringplug™ Full time

    Experience Required: 4-8 yrs.Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required.Immediate requirement: 15-20 days joiner only.Data EngineerKey Skills: Azure Data Factory, Pyspark, T/SQL, PL/SQL, Exposure on other ETL Tools like SSIS, Databricks, LookerData EngineeringCreate and maintain optimal data pipeline architectureDesign...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Virtusa Full time

    Data Engineer - CREQ188856 Description Job Description Skill: Data Engineer Role: T3, T2 Key responsibility: Role Name: Data EngineerMust have 5+ years of experience in below mentioned skills.Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka,...

  • Data Engineer

    2 weeks ago

    gurgaon, India Battery Smart Full time

    Position: Data Engineer (Python)Experience: 2-3 yearsLocation: Gurugram, HaryanaRoles & Responsibilities:• As a data analytics intern, you will work closely with the data analytics team to analyze and interpret data, develop data visualizations, and assist in data-driven decision-making processes.• This includes collecting and cleaning data, conducting...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India GlobalLogic Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer with expertise in Apache Spark, Scala, and Java to join our dynamic team. The ideal candidate will have a strong background in data engineering, a deep understanding of big data technologies, and the ability to design and implement scalable data processing solutions.Job...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India GlobalLogic Full time

    Job Description:We are looking for a highly skilled Data Engineer proficient in Apache Spark, Scala, and Java to be part of our team. The ideal candidate should have a solid background in data engineering, a profound knowledge of big data technologies, and the capacity to create and deploy scalable data processing solutions.Responsibilities:Data Pipeline...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Eucloid - Data Engineer - Azure Databricks

    4 weeks ago

    Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India hiringplug™ Full time

    Experience Required: 4-8 yrs.Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required.Immediate requirement: 15-20 days joiner only. Data EngineerKey Skills: Azure Data Factory, Pyspark, T/SQL, PL/SQL, Exposure on other ETL Tools like SSIS, Databricks, LookerData Engineering Create and maintain optimal data pipeline architecture Design...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...