Data Engineer

1 day ago

Hubli, Karnataka, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,50,000
Job Overview

We are seeking a seasoned Data Engineer to design, develop, and maintain scalable data platforms. The ideal candidate will have extensive experience in data engineering, cloud infrastructure, and strong DevOps/SRE skills.

The successful candidate will be responsible for:

  • Designing and implementing efficient data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse or data lake environment.
  • Automating and managing the underlying infrastructure for our data platforms (e.g., Airflow, Spark clusters), applying SRE and DevOps best practices for performance, reliability, and observability.
  • Collaborating with stakeholders to gather requirements and translate business needs into robust technical solutions.
  • Optimizing and tuning existing data pipelines and infrastructure for performance, cost, and scalability.
  • Implementing data quality and governance processes to ensure data accuracy, consistency, and compliance with regulatory standards.
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in data engineering, platform engineering, or a similar role, with a strong focus on building and maintaining data pipelines and the underlying infrastructure.
  • Proven experience in DevOps, SRE, or System Engineering roles, with hands-on expertise in infrastructure as code (e.g., Terraform, Ansible), CI/CD pipelines, and monitoring/observability tools.
  • Expertise in SQL programming and database management systems (e.g., BigQuery).
  • Hands-on experience with ETL tools and technologies (e.g., Apache Spark, Apache Airflow).
  • Experience with cloud platforms such as Google Cloud Platform (GCP), and experience with relevant services (e.g., GCP Dataflow, GCP DataProc, BigQuery, Cloud Composer, GKE).
  • Experience with Big Data tools like Spark, Kafka, etc.
  • Experience with object-oriented/object function scripting languages: Python/Scala, etc.
What We Offer

This is an exciting opportunity to work with a talented team of professionals who are passionate about data engineering and innovation. As a Data Engineer at our company, you will have the chance to:

  • Work on cutting-edge projects that drive business growth and improvement.
  • Collaborate with cross-functional teams to deliver high-quality data solutions.
  • Develop your skills and knowledge through ongoing training and mentorship programs.
  • Enjoy a dynamic and supportive work environment that fosters creativity and collaboration.
About Us

We are a leading organization in the data engineering space, dedicated to delivering innovative solutions that meet the evolving needs of our clients. Our team is comprised of experienced professionals who share a passion for data engineering and a commitment to excellence.

  • Ai Security Engineer

    5 days ago

    Hubli, Karnataka, India NTT DATA Full time

    Req ID 338875 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AI Security Engineer - Shared Security Services Engineering to join our team in Banaglore Karn taka IN-KA India ...

  • Senior Data Engineer

    14 hours ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Data Engineer PositionThis is a crucial data engineer role for an organization. The ideal candidate will have a deep understanding of data engineering principles and be able to apply them to real-world problems.The successful applicant will design and develop data pipelines using Python and cloud-based tools, implement data warehousing and ETL solutions,...

  • Data Engineering Specialist

    3 days ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 24,00,000 - ₹ 40,00,000

    Job Title: Data Engineering SpecialistWe are seeking a seasoned data engineering specialist to lead our organization's data warehousing, big data, and data analytics initiatives.Total years of experience: 9+ Years required for this position.The ideal candidate should have extensive skills and success in the implementation of technology projects within a...

  • Senior Data Engineer

    1 day ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    About Our Data Engineering RoleWe're seeking a seasoned data engineer to spearhead our analytics team's growth and development.This strategic position requires someone with extensive experience in handling log-level data, cross-platform engineering, and proficiency in modern business intelligence tools.The ideal candidate will play a pivotal role in...

  • Senior Data Engineer

    1 week ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,20,00,000

    As a senior data engineer, you will be responsible for designing and implementing scalable, secure, and efficient solutions on the Databricks platform.The ideal candidate will have experience working with Databricks, including platform architecture, data engineering, and data analytics. Proficiency in languages such as Python, Scala, or Java is also...

  • Data Engineer Specialist

    3 days ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 25,00,000

    Job Role: Data Engineering ExpertPrimary Responsibilities:Design, develop, and implement data pipelines leveraging Oracle Data Flow or Apache Spark (PySpark)Ensure seamless integration and automation across data services by orchestrating data workflowsCollaborate effectively with cross-functional teams and engage with stakeholders to drive business...

  • Data Engineer

    3 days ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,08,09,120 - ₹ 2,08,18,200

    About the RoleWe are seeking a skilled Data Engineer to join our team and contribute to the design, development, and maintenance of ETL pipelines using Azure Data Factory.The ideal candidate will have expertise in designing and implementing data transformation workflows, integrating data from various sources, and ensuring data quality and reliability.Key...

  • Cloud Data Engineer

    1 day ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,70,88,000 - ₹ 2,41,12,000

    Job Title: Cloud Data EngineerWe are seeking a highly skilled data engineer to join our team.The ideal candidate will be responsible for designing, implementing and optimizing data pipelines on our data platform.Data Pipeline Development: Design, develop and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data...

  • Data Engineering Expert

    7 days ago

    Hubli, Karnataka, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Software Engineering SpecialistWe are looking for a skilled Software Engineering Specialist to join our team. This role involves developing and optimizing data engineering pipelines using various technologies.This position requires experience with Azure Data Factory (ADF), Databricks, and Synapse Analytics.You will be responsible for designing scalable data...

  • Senior Data Engineer

    3 hours ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Engineer">Overview:">We are seeking a highly skilled and experienced data engineer to design and implement scalable IoT data solutions utilizing AWS services.">Key Responsibilities:">">Design, develop, and deploy large-scale IoT data pipelines using AWS services.">Write efficient, reusable, and maintainable Python code for data...