Highly Skilled Python Data Engineer Wanted

22 hours ago

Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title: Lead Data Engineer - Python & GCP

We are seeking a highly skilled and motivated individual to join our data engineering team. As a Lead Data Engineer, you will be responsible for designing, architecting, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines.

The ideal candidate will have strong experience in Python programming and Google Cloud Platform (GCP) services. You will work closely with customers directly, gathering requirements, discovering opportunities, designing solutions, and implementing data transformations, data ingestion, and data quality checks.

Key Responsibilities:

  • Design, develop, test, and maintain scalable ETL data pipelines using Python.
  • Architect enterprise solutions using various technologies such as Kafka, multi-cloud services, auto-scaling using GKE, Load balancers, APIGEE proxy API management, DBT, and LLMs as needed.
  • Work extensively on GCP services such as Dataflow for real-time and batch data processing, Cloud Functions for lightweight serverless compute, BigQuery for data warehousing and analytics, Cloud Composer for orchestration of data workflows on Apache Airflow, Google Cloud Storage (GCS) for managing data at scale, IAM for access control and security, and Cloud Run for containerized applications.

Required Skills and Qualifications:

  • 10 to 12 years of hands-on experience in Python for backend or data engineering projects.
  • Strong understanding and working experience with GCP cloud services, especially Dataflow, BigQuery, Cloud Functions, and Cloud Composer.
  • Solid understanding of data pipeline architecture, data integration, and transformation techniques.
  • Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
  • Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, and GCP Composer DAGs.
  • Strong experience in SQL with at least one enterprise database such as SQL Server, Oracle, PostgreSQL, etc.
  • Experience in data migrations from on-premise data sources to Cloud.

Benefits:

  • Excellent problem-solving and analytical skills.
  • Strong communication skills and ability to collaborate in a team.
  • Bachelor's degree in Computer Science, a related field, or equivalent experience.

Others:

  • Candidates should have a strong passion for technology and innovation.
],

  • Highly Skilled Python Developer Wanted

    5 days ago

    Hyderabad, Telangana, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 20,00,000

    Python Software EngineerWe are seeking a highly skilled Python software engineer to join our team. The ideal candidate will have strong knowledge of the Python programming language and experience in developing scalable, high-performance applications.The successful candidate will be responsible for designing, implementing, and maintaining complex software...

  • Highly Skilled QA Automation Engineer Wanted

    14 hours ago

    Hyderabad, Telangana, India beBeeAutomation Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Senior QA Automation EngineerWe are seeking a highly skilled and experienced Senior QA Automation Engineer to join our team. As a key member of our quality assurance team, you will be responsible for designing, developing, and maintaining automation scripts using Python for web, API, and data workflows.This role requires strong proficiency in...

  • Highly Skilled Data Engineering Expert Wanted

    3 days ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced data engineering professional to join our organization. The ideal candidate will have a strong background in designing, building, and operationalizing large-scale enterprise data solutions using cloud services.Key Responsibilities:Design, build, and operationalize large-scale...

  • Highly Skilled Senior Data Engineering Professional Wanted

    1 day ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Overview:">We are seeking a highly skilled Senior Data Engineer to join our team for an onsite BFSI client project in Hyderabad/Bengaluru, India. The successful candidate will have the opportunity to consult on complex software engineering initiatives and contribute to the design and implementation of robust data solutions.">Key...

  • Highly Skilled Data Solutions Engineer Wanted

    6 days ago

    Hyderabad, Telangana, India beBeeDataGovernance Full time US$ 1,20,000 - US$ 1,40,000

    Software Data Solutions EngineerAbout the RoleWe are seeking a highly skilled and experienced engineer to drive the design, development, and governance of data solutions.Your expertise in software engineering, data systems, and data governance will play a critical role in building scalable and efficient data platforms and tools while ensuring data integrity...

  • Highly Skilled Big Data Engineer Wanted

    22 hours ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Engineer RoleAs a Big Data Engineer, you will be responsible for designing and implementing scalable data pipelines using AWS services, Python, Spark, and Kafka. This includes integrating structured and unstructured data from various sources into data lakes and warehouses.Key Responsibilities:Design and implement data pipelines using AWS services,...

  • Highly Skilled Software Developer Wanted

    1 day ago

    Hyderabad, Telangana, India beBeeSoftwareEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Are you passionate about developing intelligent systems? We are looking for skilled professionals to join our team as Software Engineer. In this role, you will have the opportunity to work on exciting projects and contribute to the growth of our organization.Job Description:We are seeking a highly motivated and experienced Software Engineer to join our team....

  • Highly Skilled Python Software Engineer

    1 day ago

    Hyderabad, Telangana, India beBeePythonDeveloper Full time ₹ 12,00,000 - ₹ 25,00,000

    We are seeking a highly skilled professional to fill the role of Python Developer at our organization. Job Description:In this position, you will be responsible for developing and maintaining high-quality software applications using Python programming language.You will work closely with cross-functional teams to identify business requirements and design...

  • Highly Analytical Data Engineer Wanted

    3 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineer OpportunityWe are seeking a highly analytical and entrepreneurial individual with strong design skills to join our Advanced Analytics team.This role involves designing and developing world-class technology solutions to solve business problems across multiple client engagements.Collaborate with other teams to understand business requirements,...

  • Highly Skilled Data Processing Specialist Wanted

    3 days ago

    Hyderabad, Telangana, India beBeeGcp Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity:Data EngineerWe are seeking a skilled professional to design, develop and maintain large-scale data processing systems.The ideal candidate will be responsible for:Designing and implementing data pipelines using GCP tools such as BigQuery, Cloud Storage, and Dataflow.Developing and maintaining ETL processes using Python and PLSQL.Collaborating...