Lead Data Pipeline Developer

2 days ago

Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Data Engineer

We are seeking a skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing and maintaining ETL/ELT data pipelines that ingest data from various sources into our data warehouse.

  • Pipeline Development: Design and develop efficient data pipelines using AWS services such as AWS Lambda, AWS DMS, and AWS Glue.
  • Data Quality: Implement robust data quality checks to ensure accuracy and reliability of all delivered datasets and reports.
  • Scheduling and Monitoring: Utilize Apache Airflow to manage and monitor scheduled data workflows.
  • Collaboration: Work closely with stakeholders to translate project requirements into technical solutions ensuring seamless integration with existing data pipelines.

About the Role:

  • Proven Experience: Proven experience as a Data Engineer or in a similar role.
  • Strong Skills: Strong proficiency in SQL scripting and Python for data manipulation and automation.
  • Tools and Technologies: Experience with Apache Airflow for workflow orchestration, AWS Cloud services including Lambda, DMS, and Glue.
  • Knowledge and Understanding: Solid understanding of data warehousing concepts with practical experience using Snowflake.
  • Communication and Collaboration: Excellent problem-solving skills, ability to design and implement solutions based on business requirements, and strong communication and collaboration skills.

Benefits:

  • Professional Growth: Opportunities for professional growth and development in a dynamic and innovative environment.
  • Collaborative Team: Collaborate with a talented team of professionals who share your passion for data engineering.
  • Flexible Work Arrangements: Flexible work arrangements to support work-life balance.

  • Position: Data Pipeline Lead

    4 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Senior Data Engineer Position">We are looking for a seasoned Senior Data Engineer to join our team and lead the design, development, and maintenance of scalable data pipelines using Google Cloud Platform (GCP), BigQuery, DataProc (PySpark), and Informatica.]"The ideal candidate will have hands-on expertise in GCP, including BigQuery, DataProc, Cloud Storage,...

  • Lead Data Pipeline Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Job Title: Senior Data EngineerAbout the Role:This is an exceptional opportunity to join our organization as a Senior Data Engineer. As a key member of our data team, you will be responsible for designing, building, and optimizing scalable data pipelines using cloud-native technologies.Key Responsibilities:Design and architect high-throughput ETL pipelines...

  • Senior Data Pipeline Developer

    3 days ago

    Bengaluru, Karnataka, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Job Description:">We are seeking a skilled and experienced Data Engineer to help build, optimize, and maintain data pipelines and architectures. The ideal candidate will have deep expertise in the Microsoft data engineering ecosystem, particularly leveraging tools such as Azure Data Factory, Databricks, Alteryx, Synapse Analytics, and a strong command of...

  • Senior Data Pipeline Developer

    13 hours ago

    Bengaluru, Karnataka, India beBeeIntegration Full time US$ 80,000 - US$ 1,50,000

    Job DescriptionWe are seeking a skilled Data Integration Specialist to join our team. The successful candidate will have deep expertise and proven success using analytical thinking and iterative problem-solving to manage programs and processes strategically and tactically.The role involves designing, developing, and maintaining complex data pipelines,...

  • Senior Data Pipeline Developer

    7 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 30,00,000

    Data Engineering SpecialistWe are seeking a highly skilled Data Engineer to join our organization. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines to support our growing business needs.You will collaborate with analytics and business teams to improve data models that...

  • Databricks Lead Urgent

    5 days ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Databricks Lead to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Wyndham Group of Hotels is...

  • Data Pipeline Specialist

    14 hours ago

    Bengaluru, Karnataka, India beBeeDataPipeline Full time US$ 1,00,000 - US$ 1,50,000

    Job Overview- We are seeking a highly skilled Data Pipeline Specialist to join our team. The ideal candidate will have experience building and productionizing data pipelines using industry-leading technologies.- A strong background in working with complex SQL datasets is required, as well as expertise in building efficient SQL scripts using BigQuery Syntax-...

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineering Professional RoleWe are seeking a highly skilled Data Engineering professional to design, develop, and maintain scalable and reliable data pipelines using Google Cloud Platform (GCP) tools.

  • Data Pipeline Architect

    16 hours ago

    Bengaluru, Karnataka, India beBeeETLDeveloper Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    About the RoleWe are seeking a skilled Senior ETL Developer to join our team.The successful candidate will be responsible for evaluating and understanding current-state Informatica ETL jobs, mappings, workflows, and dependencies.Key responsibilities include:Evaluating and redesigning data pipelines using Databricks (PySpark/Scala/SQL) to optimize performance...

  • Principal Architect for Scalable Data Pipelines

    16 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time

    Job Opening: Senior Data EngineerA seasoned Senior Data Engineer is required to lead the design and development of scalable data pipelines using Talend, orchestrating complex ELT workflows into Snowflake.The ideal candidate will have expertise in Studio, TAC, and AWS services (S3, EC2, RDS, and No SQL) and a deep understanding of SQL skills and performance...