Data Engineer

4 months ago

Gurgaon, India Corning Full time

Requisition Number: 63042

 

Corning is vital to progress – in the industries we help shape and in the world we share.

We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts, works, learns, and lives.

Our sustained investment in research, development, and invention means we’re always ready to solve the toughest challenges alongside our customers. 



The global Information Technology (IT) Function is leading efforts to align IT and Business Strategy, leverage IT investments, and optimize end to end business processes and associated information integration technologies.  Through these efforts, IT helps to improve the competitive position of Corning's businesses through IT enabled processes.  IT also delivers Information Technology applications, infrastructure, and project services in a cost efficient manner to Corning worldwide.

Scope of Position:

The Data Engineer, Analytics will be responsible for the architecture, implementation and governance of Corning Life Sciences’ data lake supporting the division’s centralized analytics platform. You will be joining an exciting, newly formed analytics center of excellence for the Corning Life Science division. Our mission is to add value to the business by utilizing our expertise in data engineering, statistics, and machine learning to identify and address the biggest opportunities to grow our $1B+ business. This position is located in our Gurugram, India office.

 

Required Education and Years of Experience:

  • Bachelor's degree in Computer Science, Engineering, or related discipline
  • 3+ years of experience in data engineering roles, developing and maintaining production ETL and ELT pipelines for data warehousing, on-premise or in cloud-based data lake environments
  • 1+ years of demonstrated production programming proficiency in at least one scripting language such as Python
  • 1+ years of experience developing data ingestion pipelines using Apache Spark APIs such as pySpark

 

Required Skills

  • Technical familiarity with Apache Spark architecture, S3, parquet and Delta Lake architecture, technologies, and tools
  • Experience with agile software development & continuous integration + continuous deployment methodologies along with supporting tools such as Git (Gitlab),and  Jira
  • Experience with established enterprise ETL and integration tools such as Informatica, Mulesoft
  • Proven success in collaborating with other technical and non-technical teams to collect and understand requirements, and describe data modeling decisions within business context
  • Excellent organizational skills including prioritization of multiple concurrent projects while still delivering timely and accurate results

 

Day to Day Responsibilities:

  • Design, test, deploy and maintain production big-data ingestion pipelines using agile software development and continuous delivery and/or continuous deployment (CI/CD) practices, collaborating closely with the advanced analytics platform team
  • Work with cross-organizational data source teams to define data ingestion requirements for structured, unstructured and semi-structured data, pilot their implementation, and ensure user acceptance
  • Define and implement automated validation and profiling capabilities needed to ensure reliable data delivery, using agile software development and CI/CD practices
  • Work with data source teams, domain experts, analysts and data scientists to define and develop data transformation, cleansing and data enrichment processes
  • Actively participate in code reviews and technical information sharing with your team members and the broader software engineering community at Corning
  • Develop and implement data governance processes to support a robust and well documented data lake environment
  • Stay up to date with industry standards and technological advancements that will improve the quality, productivity and performance of your work
  • Provide support in a DevOps environment to monitor overall system performance

 

Desired Experience / Qualifications / Skills:

  • Master’s degree in Computer Science, Engineering, or related discipline
  • Familiarity with Oracle, Microsoft SQL Server, SSIS, SSRS data technologies
  • Familiarity with the Databricks Platform and notebook environments
  • Familiarity with reporting and analysis tools such as PowerBI, Tableau, or SAS JMP

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HuQuo Consulting Pvt. Ltd. The ideal candidate will have a strong background in data engineering, analytics, and software development.Key Responsibilities:Design and develop data pipelines using ETL tools and technologies such as Oracle, Python, and AWS services.Manage...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Title: Data EngineerAt IFlowTech Solutions Private Limited, we are seeking a highly skilled Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data pipelines and architectures to support business...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Turnberry Solutions Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Turnberry Solutions. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on Google Cloud Platform (GCP).Key Responsibilities:Design and implement data pipelines using GCP offerings such as BigQuery and...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Nutrabay Full time

    Data EngineerWe are seeking a skilled Data Engineer to help us drive innovation in data engineering concepts and technologies. The ideal candidate will be responsible for designing and implementing data pipelines for extracting, transforming, and loading data from various sources to our data warehouses and data lakes.Key Responsibilities:Design and implement...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Data EngineerHuQuo Consulting Pvt. Ltd. is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems on Google Cloud Platform.Key Responsibilities:Design and implement data pipelines using Google Cloud Platform services such as BigQuery, DataFlow, Pub/Sub,...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Huquo Consulting Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Huquo Consulting. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and develop data pipelines to extract, transform, and load data from...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India TransOrg Analytics Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at TransOrg Analytics. As a Data Engineer, you will be responsible for designing and implementing data engineering projects, integrating multiple data sources, and performing data ingestion and ETL processes.Responsibilities:Design and implement data engineering projects...

  • Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India The Nielsen Company Full time

    About the RoleNielsen is seeking a skilled Data Engineer to join our OpIntel team. As a Data Engineer, you will be responsible for designing, developing, and supporting complex data engineering software solutions for analytical data storage. You will work closely with offshore team members in the software development lifecycle process.Key...

  • Senior Network Engineer

    3 days ago

    Gurgaon, Haryana, India NTT DATA Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Strawberry Infotech Pvt. Ltd Full time

    Job Title: Data EngineerStrawberry Infotech Pvt. Ltd is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a vital role in designing and implementing data solutions that drive business intelligence and analytics.Key Responsibilities:Design, build, and maintain data pipelines using Azure Data Factory.Develop and manage...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Huquo Consulting Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Huquo Consulting. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and develop data pipelines using ETL tools and technologies such as Oracle, Python, and AWS...

  • Data Engineer

    3 weeks ago

    Gurgaon, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big PlusData engineering pipeline build on big data on GCPSomeone who has worked with GCPStrong SQLStrong big...

  • Data Engineer

    1 week ago

    Gurgaon, Haryana, India The Nielsen Company Full time

    About the RoleNielsen is seeking a highly skilled Data Engineer to join our OpIntel team. As a Data Engineer, you will be responsible for designing, developing, and supporting complex data engineering software solutions for analytical data storage.Key ResponsibilitiesDesign and develop highly complex data engineering software solutions for analytical data...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Paddlelift Full time

    Job Title: Data EngineerAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Paddlelift. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data pipelines and ETL processes.Key Responsibilities:Design and develop data pipelines and ETL processes to extract, transform, and load data from...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Paddlelift Full time

    Job Title: Data EngineerAbout the Role:Paddlelift is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data pipelines and ETL processes.Key Responsibilities:Design and develop data pipelines and ETL processes to extract, transform, and load data from...

  • Data engineer

    3 weeks ago

    Gurgaon, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in Big Query/ Big Table/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong...

  • Data Engineer

    3 weeks ago

    Gurgaon, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ Pyspark Worked on prior data engineering projects leveraging GCP product offerings Strong SQL background Prior Amex Bigdata experience is big Plus Data engineering pipeline build on big data on GCP Someone who has worked with GCP Strong SQL Strong...

  • Data Engineer

    5 days ago

    Gurgaon, Haryana, India AXA Group Full time

    Data Engineering at AXA GroupWe are seeking an experienced Data Engineer to join our team at AXA Group. As a key member of our Data Engineering team, you will be responsible for designing, developing, and maintaining our Enterprise data lake.Key Responsibilities:Design and develop ETL pipelines using Informatica Power Center and SQL Stored ProceduresWork...

  • Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BayOne Solutions. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems on cloud platforms like Azure, AWS, and GCP.Key Responsibilities:Design and implement data warehouses and data lakes using modern technologies...

  • Data Engineer

    6 hours ago

    gurgaon, India Turnberry Solutions Full time

    Experienced data engineer with hands on experience on GCP offerings Experienced in BigQuery/ BigTable/ PysparkWorked on prior data engineering projects leveraging GCP product offeringsStrong SQL backgroundPrior Amex Bigdata experience is big Plus- Data engineering pipeline build on big data on GCP- Someone who has worked with GCP- Strong SQL- Strong big...