Data Engineer

7 days ago

Bengaluru, Karnataka, India Siemens Full time US$ 90,000 - US$ 1,20,000 per year

We are looking for Data Engineer ( AWS, Confluent & Snaplogic )

  • Data Integration: Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching.
  • Data Processing: Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading.
  • Data Storage: Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval.
  • Data Transformation: Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
  • Data Products: Create and maintain data products that meet the needs of various stakeholders, providing actionable insights and supporting data-driven decision-making.
  • Workflow Management: Use Apache Airflow to orchestrate and automate data workflows, ensuring timely and accurate data processing.
  • Real-time Data Streaming: Utilize Confluent Kafka for real-time data streaming, ensuring low-latency data integration and processing.
  • ETL Processes: Design and implement ETL processes using SnapLogic, ensuring efficient data extraction, transformation, and loading.
  • Monitoring and Logging: Use Splunk for monitoring and logging data processes, ensuring system reliability and performance.

Youd describe yourself as:

  • Experience: 3+ relevant years of experience in data engineering, with a focus on AWS Glue, Iceberg tables, Confluent Kafka, SnapLogic, and Airflow.

  • Technical Skills:

  • Proficiency in AWS services, particularly AWS Glue.

  • Experience with Iceberg tables and Snowflake.
  • Knowledge of Confluent Kafka for real-time data streaming.
  • Familiarity with SnapLogic for ETL processes.
  • Experience with Apache Airflow for workflow management.

  • Understanding of Splunk for monitoring and logging.

  • Programming Skills: Proficiency in Python, SQL, and other relevant programming languages.

  • Data Modeling: Experience with data modeling and database design.
  • Problem-Solving: Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues.

Preferred Qualities:

  • Attention to Detail: Meticulous attention to detail, ensuring data accuracy and quality.
  • Communication Skills: Excellent communication skills, with the ability to collaborate effectively with cross-functional teams.
  • Adaptability: Ability to adapt to changing technologies and work in a fast-paced environment.
  • Team Player: Strong team player with a collaborative mindset.
  • Continuous Learning: Eagerness to learn and stay updated with the latest trends and technologies in data engineering.

This role, based in Bangalore, is an individual contributor position. You may be required to visit other locations within India and internationally. In return, you'll have the opportunity to work with teams shaping the future.

  • Data Entry Operator

    2 weeks ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    22 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Data Engineer

    1 day ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    20 hours ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Technical Lead- Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data Senior Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...