Senior Data Engineer

3 days ago


Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title: Data Engineering Lead

We are seeking a highly skilled Data Engineering Lead to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines for batch and real-time processing using GCP tools.

In this role, you will construct large datasets to meet diverse business needs, translate business requirements into technical specifications, and leverage GCP services including Big Query, Cloud Dataflow, Cloud Run, Cloud Functions, and Pub/Sub to build integrated systems.

Key Responsibilities:
  • Expertise in GCP Services:
    • Big Query
    • Cloud Dataflow (Apache Beam)
    • Cloud Run, Cloud Functions, Cloud Storage
    • Pub/Sub, Cloud Composer (Apache Airflow)
  • Technical Skills:
    • Proficiency in Python and SQL.
    • Experience with structured ERP solutions like SAP, Oracle EBS, and Salesforce.
    • A strong understanding of different file formats (CSV, JSON, XML, Parquet, ORC, Avro).
    • Knowledge of Data Lake concepts.
    • Experience with API development and consumption (REST, SOAP).
  • Data Security & Governance:
    • Proven ability to implement IAM best practices.
    • Familiarity with data masking and anonymization techniques.

  • Senior Data Engineer

    2 weeks ago


    Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,20,00,000

    As a senior data engineer, you will be responsible for designing and implementing scalable, secure, and efficient solutions on the Databricks platform.The ideal candidate will have experience working with Databricks, including platform architecture, data engineering, and data analytics. Proficiency in languages such as Python, Scala, or Java is also...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Engineer">Overview:">We are seeking a highly skilled and experienced data engineer to design and implement scalable IoT data solutions utilizing AWS services.">Key Responsibilities:">">Design, develop, and deploy large-scale IoT data pipelines using AWS services.">Write efficient, reusable, and maintainable Python code for data...


  • Hubli, Karnataka, India Deltacubes Full time

    Job description:• Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data. This includes batch and real-time processing (in google cloud)• Build large and complex datasets based on business requirements• Construct 'big data' pipeline architecture• Identify opportunities for data acquisition...


  • Hubli, Karnataka, India beBeeData Full time US$ 1,00,000 - US$ 1,20,000

    Job Title:Key Responsibilities of a Senior Data SpecialistOverview:Design and implement data pipelines using Python and AWS services such as S3, Redshift, Lambda, and Glue.As a senior data specialist, you will be responsible for developing and maintaining large-scale data systems that support business analytics and reporting requirements.Requirements:7+...


  • Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 22,00,000

    Job Title: Data Engineering Scrum MasterA senior data engineer with experience in scrum methodology is required to lead agile teams and ensure data quality.Responsibilities:Lead agile teams using scrum methodologyEnsure data integrity through documentation and processingCollaborate with cross-functional teams to drive business outcomesRequirements:6-8 years...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Data Engineer PositionThis is a crucial data engineer role for an organization. The ideal candidate will have a deep understanding of data engineering principles and be able to apply them to real-world problems.The successful applicant will design and develop data pipelines using Python and cloud-based tools, implement data warehousing and ETL solutions,...

  • Data Engineer

    1 week ago


    Hubli, Karnataka, India Lenity Health Full time

    Role Overview Location: Hebbal, Bengaluru Work Mode: Monday to Friday | On-site Work Time: 2pm - 11pm Compensation: ₹15-20 LPA (negotiable based on experience) Experience Level: 3+ years About Lenity Health The healthcare industry operates on systems so outdated, that it clogs the flow of innovation and efficient care coordination. These...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 17,50,000 - ₹ 25,75,000

    Senior Data Engineer OpportunityWe are seeking an experienced Senior Data Engineer to lead the development of our self-service data platform for reporting and analytics.Key Responsibilities:Design and implement scalable technologies such as Databricks, SQL, Python, Spark, and Delta Lake on Azure.Ensure adherence to best practices for Extract, Transform, Load...


  • Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a visionary Senior Data Engineering Lead to lead our data engineering team.This leadership role requires a technical expert who can design, develop, and manage scalable data infrastructure and pipelines, while mentoring and inspiring a team of data engineers.Key Responsibilities:Lead and manage a team of data engineers, providing...


  • Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer OpportunityWe are seeking a highly skilled Senior Data Engineer to join our team. This is a senior-level position that requires expertise in designing and implementing data load processes using Azure Data Factory, Databricks, Delta Lake, Azure Delta Lake Storage, and Python/PySpark.The ideal candidate will have proficiency with...