Sr Data Engineer

19 hours ago

Bengaluru, Karnataka, India Illumina Full time
Job Description

Responsibilities:

- Lead the design, development, and optimization of data pipelines, ETL processes, and data integration solutions using Python, Spark, SQL, Snowflake, dbt, and other relevant technologies.
- Apply strong domain expertise in operations organizations, particularly in functions like supply chain and manufacturing, to understand data requirements and deliver tailored solutions.
- Utilize big data processing frameworks such as Apache Spark to process and analyze large volumes of operational data efficiently.
- Implement data transformations, aggregations, and business logic to support analytics, reporting, and operational decision-making.
- Leverage cloud-based data platforms such as Snowflake to store and manage structured and semi-structured operational data at scale.
- Utilize dbt (Data Build Tool) for data modeling, transformation, and documentation to ensure data consistency, quality, and integrity.
- Monitor and optimize data pipelines and ETL processes for performance, scalability, and reliability in operations contexts.
- Conduct data profiling, cleansing, and validation to ensure data quality and integrity across different operational data sets.
- Collaborate closely with cross-functional teams, including operations stakeholders, data scientists, and business analysts, to understand operational challenges and deliver actionable insights.
- Stay updated on emerging technologies and best practices in data engineering and operations management, contributing to continuous improvement and innovation within the organization.

Preferred Experience/Education/Skills:

- Bachelors degree in Computer Science, Engineering, Operations Management, or related field.
- 5+ years of experience in data engineering, with proficiency in Python, Spark, SQL, Snowflake, dbt, and other relevant technologies.
- Strong domain expertise in operations organizations, particularly in functions like supply chain and manufacturing.
- Strong domain expertise in life sciences manufacturing equipment, with a deep understanding of industry-specific challenges, processes, and technologies.
- Experience with big data processing frameworks such as Apache Spark and cloud-based data platforms such as Snowflake.
- Hands-on experience with data modeling, ETL development, and data integration in operations contexts.
- Familiarity with dbt (Data Build Tool) for managing data transformation and modeling workflows.
- Familiarity with reporting and visualization tools like Tableau, Powerbi etc.
- Good understanding of advanced data engineering and data science practices and technologies like pypark, sagemaker, cloudera MLflow etc.
- Experience with SAP, SAP HANA and Teamcenter applications is a plus.
- Excellent problem-solving skills, analytical thinking, and attention to detail.
- Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and operations stakeholders.
- Eagerness to learn and adapt to new technologies and tools in a fast-paced environment.

  • Digital Engineering Sr. Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 268395NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Sr Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Role...

  • Sr. Data Science

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 312480NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Sr Data Science AIML GenAI Lead Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties...

  • Sr Frontend Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Frontend Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).Who we are:NTT DATA America's strives...

  • Sr Full Stack Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Full Stack Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).Engineering Full Stack Frontend -...

  • Sr Integration Engineer

    2 hours ago

    Bengaluru, Karnataka, India beBeeIntegration Full time ₹ 15,00,000 - ₹ 25,00,000

    Sr Integration Engineer JobWe are seeking an experienced Sr Integration Engineer to join our team. As a Sr Integration Engineer, you will be responsible for designing, developing, and maintaining real-time and batch processing integrations in the SnapLogic Integration Platform.

  • Testing Engineering Sr Analyst

    7 hours ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionReq ID:333644NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Testing Engineering Sr Analyst to join our team in Bangalore, Karntaka (IN-KA), India (IN).Java,...

  • Sr. .Net Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionReq ID:331298NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr. .Net Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).Senior Application...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time

    Job DescriptionReq ID: 330827NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bengaluru, Karntaka (IN-KA), India (IN).Sr Developer - Data...

  • Sr Data Engineer

    7 hours ago

    Bengaluru, Karnataka, India Elanco Full time

    At Elanco NYSE ELAN - it all starts with animals As a global leader in animal health we are dedicated to innovation and delivering products and services to prevent and treat disease in farm animals and pets We re driven by our vision of Food and Companionship Enriching Life and our approach to sustainability - the Elanco Healthy Purpose TM - to...

  • Sr Alloy DB Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionReq ID:331754NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Alloy DB Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).The Senior Applications...