Senior Cloud Data Engineering Professional

4 days ago

Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000
Job Description

We are seeking an experienced and skilled Data Engineer to join our team.

As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms.

The ideal candidate will possess a strong command of Python, data engineering principles, and a proven track record of successful implementation of scalable solutions in cloud environments.

  • Data Pipeline Development:
    • Design, develop, and maintain scalable and efficient data pipelines using Python and cloud-based technologies.
    • Implement Extract, Transform, Load (ETL) processes to seamlessly move data from diverse sources into our cloud-based data warehouse.
  • Cloud Integration:
    • Utilize cloud platforms (e.g., Google Cloud, AWS, Azure) to deploy, manage, and optimize data engineering solutions.
    • Leverage cloud-native services for storage, processing, and analysis of large datasets.
  • Collaboration and Communication:
    • Work closely with data scientists, analysts, and other teams to understand data requirements and provide technical support.
    • Collaborate with other engineering teams to seamlessly integrate data engineering solutions into larger cloud-based systems.
Required Skills and Qualifications

Proficiency in Python for data engineering tasks, scripting, and automation.

Extensive experience with data engineering frameworks like distributed data processing.

Understanding and hands-on experience with workflow management tools like Apache Airflow.

In-depth knowledge and hands-on experience with at least one major cloud platform: AWS, Azure, or Google Cloud.

Familiarity with cloud-native services for data processing, storage, and analytics.

Proven expertise in designing and implementing Extract, Transform, Load (ETL) processes.

SQL and Databases: Proficient in SQL with experience in working with relational databases (e.g., PostgreSQL, MySQL) and cloud-based database services.

Version Control: Familiarity with version control systems, such as Git, for tracking changes in code and configurations.

Containerization and Orchestration: Familiarity with containerization technologies (e.g., Docker) and orchestration tools (e.g., Kubernetes).

Monitoring and Troubleshooting: Ability to implement monitoring solutions and troubleshoot issues in data pipelines.

Agile Methodologies: Familiarity with agile development methodologies and practices.

Soft Skills:

  • Strong problem-solving and critical-thinking abilities.
  • Excellent communication skills, both written and verbal.
  • Ability to work collaboratively in a cross-functional team environment.
  • Attention to detail and commitment to delivering high-quality solutions.

  • Leading Cloud Data Engineer

    4 days ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a skilled data engineer with expertise in cloud services and big data technologies to design scalable, high-performance data pipelines.Main Responsibilities:Develop and maintain data pipelines using AWS and Databricks.Create ETL/ELT processes for large-scale datasets.Apply Databricks for advanced analytics and...

  • Cloud Data Engineering Expert

    1 week ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer - Cloud ExpertWe are seeking a skilled Senior Data Engineer to join our organization. This key role will be responsible for designing and building large-scale data platforms on the Google Cloud Platform (GCP).Key Responsibilities:Design and implement robust data pipelines for ingestion, transformation, and analytics.Mandatory experience...

  • Data Engineer for Cloud Platform Development

    4 days ago

    Vizag, Andhra Pradesh, India beBeeCloudMigration Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Senior Software Engineer - Cloud Migration ExpertAbout the Role:We are seeking an experienced Senior Software Engineer to lead large-scale cloud migration projects. The ideal candidate will have a minimum of 10 years of experience in data engineering and ETL, with a strong background in migrating on-premise data systems to the cloud.Key...

  • Senior Data Engineer

    6 hours ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 19,10,000

    **Senior Data Engineer Role**We are seeking a senior data engineer to join our team and contribute to the development of our data infrastructure.The ideal candidate will have a strong background in data engineering, with experience in designing, building, and maintaining large-scale data systems.The successful candidate will be responsible for:Designing and...

  • Senior Cloud Data Engineer

    6 hours ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Data Engineer (GCP)We are seeking a seasoned Data Engineer to craft and maintain our data pipelines using Google Cloud Platform services.The ideal candidate will collaborate closely with data scientists to deliver high-quality data solutions and ensure the accuracy and integrity of our data assets.Design, develop, and deploy scalable data pipelines...

  • Senior Data Engineering Specialist

    6 days ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineering SpecialistKey Responsibilities:Design and develop high-performance data pipelines and ETL processes on Databricks.Lead the architecture and implementation of scalable, secure, and efficient data solutions.Collaborate with stakeholders to gather requirements and deliver actionable data insights.Optimize data workflows for...

  • Lead Cloud Data Architect

    6 hours ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Cloud Data EngineerWe are seeking a highly skilled Senior Cloud Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and maintaining large-scale cloud-based data systems.Key Responsibilities:Design and implement scalable data architectures using AWS services such as S3, EC2, EMR, and Lambda.Develop...

  • Cloud Data Engineering Leader

    51 minutes ago

    Vizag, Andhra Pradesh, India beBeeCloudEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Engineering LeaderAs a seasoned Cloud Data Engineering Leader, you will be responsible for managing and leading the migration of an on-premises Enterprise Data Warehouse to a modern cloud-based data platform using Azure Cloud data tools and Snowflake.Key Responsibilities:Lead the migration of the on-premises SQL Server Enterprise Data...

  • Data Engineering Professional

    2 days ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a skilled Data Engineer to join our dynamic team and design, develop, and maintain data pipelines and data warehouse solutions on Google Cloud Platform (GCP).This role is responsible for ensuring the seamless flow of data across systems, enabling data-driven decision-making for our organization and clients.About the RoleData...

  • Senior Data Engineering Specialist

    2 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking an experienced Data Engineer to lead a team of Senior Engineers and develop innovative data-intensive applications.The ideal candidate has 10+ years of experience in software development, with a focus on backend and data engineering. They should have hands-on experience in using Python, JVM, and Shell Scripting, as well as...