Data Engineer

2 months ago

Gurgaon, India Corning Full time

Requisition Number: 62779

 

Corning is vital to progress – in the industries we help shape and in the world we share.

We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts, works, learns, and lives.

Our sustained investment in research, development, and invention means we’re always ready to solve the toughest challenges alongside our customers. 

As a leading developer, manufacturer, and global supplier of scientific laboratory products for 100 years, Corning’s Life Sciences segment collaborates with researchers seeking new approaches to increase efficiencies, reduce costs and compress timelines in the drug discovery process. Using unique expertise in the fields of materials science, surface science, optics, biochemistry and biology, the segment provides innovative solutions that improve productivity and enable breakthrough discoveries.

 

 

Scope of Position:

The Data Engineer, Analytics will be responsible for the architecture, implementation and governance of Corning Life Sciences’ data lake supporting the division’s centralized analytics platform. You will be joining an exciting, newly formed analytics center of excellence for the Corning Life Science division. Our mission is to add value to the business by utilizing our expertise in data engineering, statistics, and machine learning to identify and address the biggest opportunities to grow our $1B+ business. This position is located in our Gurugram, India office.

 

Required Education and Years of Experience:

  • Bachelor's degree in Computer Science, Engineering, or related discipline
  • 3+ years of experience in data engineering roles, developing and maintaining production ETL and ELT pipelines for data warehousing, on-premise or in cloud-based data lake environments
  • 1+ years of demonstrated production programming proficiency in at least one scripting language such as Python
  • 1+ years of experience developing data ingestion pipelines using Apache Spark APIs such as pySpark

 

Required Skills

  • Technical familiarity with Apache Spark architecture, S3, parquet and Delta Lake architecture, technologies, and tools
  • Experience with agile software development & continuous integration + continuous deployment methodologies along with supporting tools such as Git (Gitlab),and  Jira
  • Experience with established enterprise ETL and integration tools such as Informatica, Mulesoft
  • Proven success in collaborating with other technical and non-technical teams to collect and understand requirements, and describe data modeling decisions within business context
  • Excellent organizational skills including prioritization of multiple concurrent projects while still delivering timely and accurate results

 

Day to Day Responsibilities:

  • Design, test, deploy and maintain production big-data ingestion pipelines using agile software development and continuous delivery and/or continuous deployment (CI/CD) practices, collaborating closely with the advanced analytics platform team
  • Work with cross-organizational data source teams to define data ingestion requirements for structured, unstructured and semi-structured data, pilot their implementation, and ensure user acceptance
  • Define and implement automated validation and profiling capabilities needed to ensure reliable data delivery, using agile software development and CI/CD practices
  • Work with data source teams, domain experts, analysts and data scientists to define and develop data transformation, cleansing and data enrichment processes
  • Actively participate in code reviews and technical information sharing with your team members and the broader software engineering community at Corning
  • Develop and implement data governance processes to support a robust and well documented data lake environment
  • Stay up to date with industry standards and technological advancements that will improve the quality, productivity and performance of your work
  • Provide support in a DevOps environment to monitor overall system performance

 

Desired Experience / Qualifications / Skills:

  • Master’s degree in Computer Science, Engineering, or related discipline
  • Familiarity with Oracle, Microsoft SQL Server, SSIS, SSRS data technologies
  • Familiarity with the Databricks Platform and notebook environments
  • Familiarity with reporting and analysis tools such as PowerBI, Tableau, or SAS JMP

  • Data Engineer

    3 days ago

    Gurgaon, Haryana, India NatWest Digital X Full time

    Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and...

  • Data Engineer

    12 hours ago

    gurgaon, India Crescent Techservices Full time

    Role : GCP Data EngineerLocation : GurgaonExperience : 3+ YearsResponsibilities:Design, develop, and maintain scalable and efficient data pipelines on Google Cloud Platform (GCP).Collaborate with data architects to implement data models and ensure seamless integration with GCP services.Extract, transform, and load (ETL) data from various sources into GCP...

  • Data Engineer

    4 days ago

    gurgaon, India Battery Smart Full time

    Position: Data EngineerExperience – 2-3 yearsEducation – Graduation in any relevant field - Computer Science, Statistics, Mathematics, or Engineering from Tier-1 InstituteLocation – Gurugram, HaryanaRoles & responsibilities -Collaborate closely with the data analytics team to analyse and interpret data effectively.Engage in the collection and cleaning...

  • Data Engineer

    2 weeks ago

    gurgaon, India EXL Full time

    Role Overview: We are looking for a go-getter person who can help support: o Data strategies to meet the demands of business requirementsTechnical requirements of the organizational data needs from diverse teamsData architecture, models and go-forward data solutions for various teams of the organization • The person will be part of the Data Solutions team...

  • Data Engineer

    1 day ago

    gurgaon, India Wipro Full time

    Band : B2Location : Offshore (Gurgaon/Bangalore)Shift Timings - 12:00 PM to 9:30 PMJob SummaryJob Overview:Our team is actively seeking a motivated and talented Visualization Engineer with Data Warehousing skills who is passionate about requirement gathering and refinement.What are we looking for?We want strong collaborators who can deliver a world-class...

  • Data Engineer

    1 day ago

    gurgaon, India BayOne Solutions Full time

    We need Data Engineers with Azure, Databricks, DataStage, SQL, Kafka; Scala/Java/Python/R, etc. (any combination); experience with BI tools (tableau, Cognos, ThoughtSpot) is a plus.Long-term contract, 2-3 rounds of interviews.Requirement:We are looking for an Onshore Data engineer with database architecture design experience as well. Here is what we are...

  • Data Engineer

    4 weeks ago

    Gurgaon,Gurugram, India E-Qube Digital Services Full time

    Position Summary :- Data Engineers are primarily responsible for designing, building, managing, and operationalizing data pipelines in support of key data and analytics use cases. - They are accountable for guaranteeing compliance with data governance, data privacy, and data security requirements.- Data Engineers are also responsible for the Enterprise...

  • Data Engineer, VP

    1 week ago

    Gurgaon, Haryana, India NatWest Digital X Full time

    Join us as a Data EngineerYou'll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-makingWe'll look to you to drive the build of effortless, digital first customer experiencesIf you're ready for a new challenge and want to make a far-reaching impact through your work, this could be the opportunity...

  • Data Engineer, VP

    1 week ago

    Gurgaon, Haryana, India NatWest Digital X Full time

    Join us as a Data EngineerYou'll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-makingWe'll look to you to drive the build of effortless, digital first customer experiencesIf you're ready for a new challenge and want to make a far-reaching impact through your work, this could be the opportunity...

  • Data Engineer, VP

    5 days ago

    Gurgaon, Haryana, India NatWest Digital X Full time

    Join us as a Data EngineerYou'll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-makingWe'll look to you to drive the build of effortless, digital first customer experiencesIf you're ready for a new challenge and want to make a far-reaching impact through your work, this could be the opportunity...

  • Senior Data Engineer

    4 weeks ago

    gurgaon, India Zupee Full time

    Senior Data EngineerWe are the biggest online gaming company with largest market share in the Indian gaming sector’s largest segment — Casual & Boardgame. We make skill-based games that spark joy in the everyday lives of people by engaging, entertaining, and enabling earning while at play.In the three plus years of existence, Zupee has been on a mission...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Senior Data Engineer

    1 week ago

    Gurgaon, India Zupee Full time

    Senior Data EngineerWe are the biggest online gaming company with largest market share in the Indian gaming sector’s largest segment — Casual & Boardgame. We make skill-based games that spark joy in the everyday lives of people by engaging, entertaining, and enabling earning while at play.In the three plus years of existence, Zupee has been on a mission...

  • Senior Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Data Engineer

    1 day ago

    gurgaon, India Think Future Technologies Full time

    *ONLY applicants with GCP experience apply*Why join us? You will get to work on multiple global products and in a nutshell, you'll end up working for more than 1 product company, at once.Qualifications:Data Engineer: 4+ YearsGCP: 3+ YearsBigQuery: 3+ YearsPython, and SQL: 3+ YearsData flow job and data pipeline creationCloud function creation, cloud...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Data Engineer

    2 weeks ago

    gurgaon, India Impetus Full time

    3-7 years of IT experience range is preferred.Worked on Hadoop EcosystemGood hands on experience on Spark and HiveAble to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big...

  • Senior Data Engineer

    1 week ago

    Gurgaon, Haryana, India Expedia Group Full time

    If you need assistance during the recruiting process due to a disability, please reach out to our Recruiting Accommodations Team through the Accommodation Request form . This form is used only by individuals with disabilities who require assistance or adjustments in applying and interviewing for a job. This form is not for inquiring about a position or the...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India United Airlines Full time

    DescriptionUnited's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people....

  • Lead Data Engineer

    5 hours ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...