Senior Cloud Data Engineer

2 days ago

Nashik, Maharashtra, India beBeeDataEngineering Full time

**Lead Data Engineer/AWS Architect**

We are seeking a highly skilled and experienced data engineer/architect to join our team. As a key leadership role, you will be responsible for leading the development of foundational components for a Lakehouse architecture on AWS and driving the migration of existing data processing workflows to the new Lakehouse solution.

In this position, you will work closely with the Data Engineering organisation to design and implement scalable data infrastructure and processes using technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue, and Glue Data Catalog. Your main goal will be to ensure successful migration and establish robust data quality governance across the new platform, enabling reliable and efficient data processing.

  • **Technical Requirements:**
    • Prior experience in leading teams, including Principal Engineers, with expertise in software architecture and solution design
    • Deep knowledge of Python and Spark, with a focus on ETL data processing and data engineering practices
    • Experience with AWS data services and engineering practices, including EMR, AWS Glue, AWS Lambda, and API Gateway
    • Delivering Lakehouse solutions/architectures is essential
  • **Nice to Have Skills:**
    • Knowledge of additional programming languages and development tools
    • A master's degree or relevant certifications (e.g., AWS Certified Solutions Architect)

**Key Responsibilities:**

  • Lead complex projects autonomously, fostering an inclusive and open culture within development teams
  • Provide strategic guidance on best practices in design, development, and implementation
  • Collaborate closely with architects, Product Owners, and Dev team members to decompose solutions into Epics
  • Drive the migration of existing data processing workflows to a Lakehouse architecture, leveraging Iceberg capabilities

**Requirements:**

  • Bachelor's degree in computer science, Software Engineering, or a related field

**Bonus Skills:**

  • Financial Services expertise preferred

  • Cloud Data Architect

    1 day ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Cloud Data Engineer - IndiaWe are seeking a seasoned Senior Cloud Data Engineer to join our team in India. This is a remote opportunity for an experienced professional to work on challenging projects for industries like Energy, Oil & Gas, Healthcare, and Finance.This role involves designing, developing, and maintaining scalable data pipelines for both...

  • Cloud Data Engineer Leadership Opportunity

    7 days ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Data Engineer PositionWe are seeking a highly experienced data engineer to lead our team. As a senior data engineer, you will be responsible for designing, developing, and optimizing ETL/ELT data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Design, develop, and optimize ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS...

  • Senior Cloud Data Engineer Position

    2 days ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    As a seasoned big data engineer, you will be responsible for designing and implementing efficient data engineering solutions on the cloud.Key Responsibilities:Develop scalable data pipelines using advanced data processing frameworksWork with massive datasets to create streamlined data processing workflowsCollaborate with cross-functional teams to implement...

  • Senior Data Engineering Position

    1 week ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Job Description:We are seeking a seasoned Senior Data Engineer to join our team. As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms.The ideal candidate will possess a strong command of Python, data engineering principles,...

  • Senior Data Engineer

    3 weeks ago

    Nashik, Maharashtra, India SPIRO Full time

    Position: Senior Data Engineer Location: Pune Experience: 5+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...

  • Senior Data Quality Engineer

    2 days ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000

    Senior Data Quality EngineerThis is a contract to hire position for an experienced Senior Data Quality Engineer with hands-on expertise in Databricks, Python scripting, and strong SQL skills. The ideal candidate will be responsible for validating data pipelines and transformations, debugging data issues, and working with large datasets in cloud...

  • AWS Cloud Data Engineer

    1 week ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Architect on AWSThis is a senior position for a skilled data architect who can lead the design, development, and deployment of end-to-end data pipelines on AWS cloud infrastructure.Key Responsibilities:Design and develop scalable data processing pipelines using services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.Implement data...

  • Senior Data Engineer Position

    1 week ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a skilled professional to assume the role of senior data engineer.Key Responsibilities:Design and implement scalable data pipelines using industry-leading tools such as FiveTran, DBT Cloud, and custom frameworks.Develop and maintain ETL pipelines, implementing client-specific data transformations and supporting data ingestion and...

  • Chief Cloud Data Engineer

    1 week ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Cloud Data Architect Position">We are seeking a highly skilled Cloud Data Architect to join our organization. The successful candidate will have expertise in designing, implementing, and maintaining data pipelines using cloud-based tools and technologies.">Key Responsibilities:">">Design and develop data pipelines using cloud-based platforms">Develop and...

  • Cloud Data Engineer Role

    1 week ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 15,00,000

    Cloud Data Engineer PositionWe are seeking a skilled Cloud Data Engineer to join our team.Our ideal candidate will have:3-7 years of experience in data engineeringProficiency in GCP, Python, PLSQL, and ETLThe selected candidate will be responsible for designing, implementing, and maintaining large-scale data processing systems. If you are interested, please...