Data Engineer

Found in: beBee S IN - 4 weeks ago

Gurgaon, India Corning Full time

Requisition Number: 62779

 

Corning is vital to progress – in the industries we help shape and in the world we share.

We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts, works, learns, and lives.

Our sustained investment in research, development, and invention means we’re always ready to solve the toughest challenges alongside our customers. 

As a leading developer, manufacturer, and global supplier of scientific laboratory products for 100 years, Corning’s Life Sciences segment collaborates with researchers seeking new approaches to increase efficiencies, reduce costs and compress timelines in the drug discovery process. Using unique expertise in the fields of materials science, surface science, optics, biochemistry and biology, the segment provides innovative solutions that improve productivity and enable breakthrough discoveries.

 

 

Scope of Position:

The Data Engineer, Analytics will be responsible for the architecture, implementation and governance of Corning Life Sciences’ data lake supporting the division’s centralized analytics platform. You will be joining an exciting, newly formed analytics center of excellence for the Corning Life Science division. Our mission is to add value to the business by utilizing our expertise in data engineering, statistics, and machine learning to identify and address the biggest opportunities to grow our $1B+ business. This position is located in our Gurugram, India office.

 

Required Education and Years of Experience:

  • Bachelor's degree in Computer Science, Engineering, or related discipline
  • 3+ years of experience in data engineering roles, developing and maintaining production ETL and ELT pipelines for data warehousing, on-premise or in cloud-based data lake environments
  • 1+ years of demonstrated production programming proficiency in at least one scripting language such as Python
  • 1+ years of experience developing data ingestion pipelines using Apache Spark APIs such as pySpark

 

Required Skills

  • Technical familiarity with Apache Spark architecture, S3, parquet and Delta Lake architecture, technologies, and tools
  • Experience with agile software development & continuous integration + continuous deployment methodologies along with supporting tools such as Git (Gitlab),and  Jira
  • Experience with established enterprise ETL and integration tools such as Informatica, Mulesoft
  • Proven success in collaborating with other technical and non-technical teams to collect and understand requirements, and describe data modeling decisions within business context
  • Excellent organizational skills including prioritization of multiple concurrent projects while still delivering timely and accurate results

 

Day to Day Responsibilities:

  • Design, test, deploy and maintain production big-data ingestion pipelines using agile software development and continuous delivery and/or continuous deployment (CI/CD) practices, collaborating closely with the advanced analytics platform team
  • Work with cross-organizational data source teams to define data ingestion requirements for structured, unstructured and semi-structured data, pilot their implementation, and ensure user acceptance
  • Define and implement automated validation and profiling capabilities needed to ensure reliable data delivery, using agile software development and CI/CD practices
  • Work with data source teams, domain experts, analysts and data scientists to define and develop data transformation, cleansing and data enrichment processes
  • Actively participate in code reviews and technical information sharing with your team members and the broader software engineering community at Corning
  • Develop and implement data governance processes to support a robust and well documented data lake environment
  • Stay up to date with industry standards and technological advancements that will improve the quality, productivity and performance of your work
  • Provide support in a DevOps environment to monitor overall system performance

 

Desired Experience / Qualifications / Skills:

  • Master’s degree in Computer Science, Engineering, or related discipline
  • Familiarity with Oracle, Microsoft SQL Server, SSIS, SSRS data technologies
  • Familiarity with the Databricks Platform and notebook environments
  • Familiarity with reporting and analysis tools such as PowerBI, Tableau, or SAS JMP

  • Data Engineer

    Found in: beBee S IN - 3 weeks ago

    Gurgaon, India Sanyukt Services Full time

    Position Overview:We are currently seeking a seasoned Data Engineer to join our dynamic team. The ideal candidate will have a minimum of 4 years of experience in data engineering roles, with a proven track record of delivering high-quality solutions in a fast-paced environment.Responsibilities:Design, build, and maintain scalable data pipelines and...

  • Data Engineer

    Found in: Whatjobs IN C2 - 1 day ago

    gurgaon, India EXL Full time

    Role Overview: We are looking for a go-getter person who can help support: o Data strategies to meet the demands of business requirementsTechnical requirements of the organizational data needs from diverse teamsData architecture, models and go-forward data solutions for various teams of the organization • The person will be part of the Data Solutions team...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Gurgaon,Gurugram, India E-Qube Digital Services Full time

    Position Summary :- Data Engineers are primarily responsible for designing, building, managing, and operationalizing data pipelines in support of key data and analytics use cases. - They are accountable for guaranteeing compliance with data governance, data privacy, and data security requirements.- Data Engineers are also responsible for the Enterprise...

  • Associate Data Engineer

    Found in: beBee jobs IN - 2 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    Job overview and responsibilitiesAs an Associate Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring the smooth flow of data and enabling efficient data analysis and reporting. You will work closely with our data scientists, analysts, and software engineers to implement data solutions that drive...

  • Data Engineer

    Found in: beBee jobs IN - 2 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Senior Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    gurgaon, India Zupee Full time

    Senior Data EngineerWe are the biggest online gaming company with largest market share in the Indian gaming sector’s largest segment — Casual & Boardgame. We make skill-based games that spark joy in the everyday lives of people by engaging, entertaining, and enabling earning while at play.In the three plus years of existence, Zupee has been on a mission...

  • Senior Data Engineer

    Found in: beBee jobs IN - 2 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Engineering Manager Big Data

    Found in: Whatjobs IN C2 - 2 weeks ago

    gurgaon, India Deutsche Telekom Digital Labs Full time

    The RoleAs an Engineering Manager, you will ensure consistency and quality by shaping the right strategies. You will keep an eye on all engineering projects and ensure all duties are fulfilled. You will also act as an Architect for this team and will be responsible for design and long-term roadmap. You will analyse other employees’ tasks and carry on...

  • Senior Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    gurgaon, India EXL Full time

    Job description (Lead Data Engineer)Job Location: Bangalore/GurgaonShift Timing: 1:00PM IST – 10:30 PM ISTBand : C2/D1Experience: 5+ yearsJob ResponsibilitiesCollaborate with project stakeholders (client) to identify product and technical requirements. Conduct analysis to determine integration needs.Use different data warehousing concepts to build a data...

  • Coforge - Data Engineer - Data Pipeline

    Found in: Whatjobs IN C2 - 2 weeks ago

    Gurgaon,Gurugram, India COFORGE Full time

    Job Description : As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Coforge - Data Engineer - Data Pipeline

    Found in: Adzuna IN C2 - 5 days ago

    Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Data Engineer

    Found in: Adzuna IN C2 - 5 days ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :Role Overview :We are looking for a go-getter person who can define :- Data strategies to meet the demands of business requirements- Technical requirements of the organizational data needs from diverse teams- Data architecture, models and go-forward data solutions for various teams of the organization- The person will be part of the Data...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Gurgaon,Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description : Role Overview :We are looking for a go-getter person who can define :- Data strategies to meet the demands of business requirements- Technical requirements of the organizational data needs from diverse teams- Data architecture, models and go-forward data solutions for various teams of the organization- The person will be part of the Data...

  • Senior Data Science Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    gurgaon, India dunnhumby Full time

    dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of...

  • Shiprocket - Data Engineer - ETL/Data Warehousing

    Found in: Adzuna IN C2 - 5 days ago

    Gurgaon/Gurugram, IN Bigfoot Retail Solutions Pvt. Ltd Full time

    Job Description :- Design and build data pipelines from various cloud data sources for the enterprise data warehouse- Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service- Own and document data...

  • Shiprocket - Data Engineer - ETL/Data Warehousing

    Found in: Whatjobs IN C2 - 2 weeks ago

    Gurgaon,Gurugram, India Bigfoot Retail Solutions Pvt. Ltd Full time

    Job Description : - Design and build data pipelines from various cloud data sources for the enterprise data warehouse- Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service - Own and document data...

  • Manager/Data Engineer

    Found in: Adzuna IN C2 - 5 days ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :The Data Engineering Team primarily work with the lead data engineer, product owners, architects, engineering teams and BI developers to implement and drive forward data & analytics goals within Risk.This is an opportunity to work as a "hands on" data engineer, engaging with a variety of stakeholders in engineering teams and the business to...

  • Manager/Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Gurgaon,Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description : The Data Engineering Team primarily work with the lead data engineer, product owners, architects, engineering teams and BI developers to implement and drive forward data & analytics goals within Risk. This is an opportunity to work as a "hands on" data engineer, engaging with a variety of stakeholders in engineering teams and the business...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Gurgaon,Gurugram, India True Tech Professionals Private Limited Full time

    Location : Gurgaon (Hybrid Mode)Experience : 5 years and above. (Less than 5 years will not be considered)Immediate Joiners Preferred (Notice Period: 7 to 10 days)We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena,...

  • Data Engineer

    Found in: Adzuna IN C2 - 5 days ago

    Gurgaon/Gurugram, IN True Tech Professionals Private Limited Full time

    Location : Gurgaon (Hybrid Mode)Experience : 5 years and above. (Less than 5 years will not be considered)Immediate Joiners Preferred (Notice Period: 7 to 10 days)We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena,...