Python Data Engineer

3 days ago

Rajahmundry, Andhra Pradesh, India beBeeDevelopment Remote Work Freelance Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

Job Overview:

We are seeking a highly skilled Python Developer to join our team. As a key member of our technology department, you will be responsible for designing and implementing cloud-based solutions using Azure and Google Cloud platforms.

Your primary responsibility will be to automate data pipelines to facilitate efficient data flow and processing. This involves working with technologies like PySpark and Databricks to develop and manage data pipelines.

To ensure the scalability and reliability of data processing workflows, you will need to have strong problem-solving skills and be able to analyze complex technical concepts.

You will also work with Large Language Models (LLMs) such as GPT and OpenAI models to enhance applications with natural language processing (NLP) capabilities. Additionally, you will design and implement prompt engineering strategies to optimize model performance in business applications.

This is an excellent opportunity for a motivated contractor who is fluent in English and has a good understanding of Data integration, Data cleanup for Knowledge 360 and other related products for knowledge system.

Key Responsibilities:

  • Design and implement cloud-based solutions using Azure and Google Cloud platforms
  • Automate data pipelines to facilitate efficient data flow and processing;
  • Develop and manage data pipelines using technologies like PySpark and Databricks;
  • Ensure the scalability and reliability of data processing workflows;
  • Work with Large Language Models (LLMs) such as GPT and OpenAI models to enhance applications with natural language processing (NLP) capabilities;
  • Design and implement prompt engineering strategies to optimize model performance in business applications;
  • Train, fine-tune, and deploy AI models, analyzing their performance based on real-world results;
  • Optimize models using feedback mechanisms to improve efficiency;
  • Utilize strong communication skills to convey complex technical concepts to non-technical stakeholders;

Requirements:

  • Bachelor or Master degree;
  • +3 years of hands-on experience in Python, Pyspark, Databricks, and cloud platforms like Azure and Google Cloud;
  • Experience in designing and implementing cloud-based solutions and automating data pipelines;
  • Experience in Working with Large Language Models (LLMs) such as GPT, OpenAI models, or enhance solutions with natural language processing (NLP) capabilities;
  • Proven ability in metadata management and schema mapping;
  • Cloud certifications (Azure, Google Cloud, or similar) are a plus;
  • Fluent in English;

  • AWS Data Engineer with Python Expertise

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineering SpecialistWe are seeking an experienced Senior Data Engineering Specialist to join our team. In this role, you will be responsible for designing and implementing robust data pipelines using AWS, Python, and SQL.Data Pipeline Design: Collaborate with cross-functional teams to design and implement scalable data pipelines that meet the...

  • Python Solution Engineer

    3 days ago

    Rajahmundry, Andhra Pradesh, India Appglide Full time

    CompanyAppGlide is a growth partner for fast growing software product companies globally. AppGlide leverages the latest technology and processes to enable SaaS companies to serve their customers better and grow faster. Based in Chennai, AppGlide is led by a team of IIT & IIM alumni.Role & Responsibility: We are looking for a Python Solution Engineer to join...

  • Data Engineer

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India Marktine Technology Solutions Pvt Ltd Full time

    Job Title: Expert Data Engineer Needed for ClickHouse, Memgraph, or Neo4j Project Mandatory Skills: Data Engineering ETL Pipeline Python Neo4j Data Science Big Data Memgraph ClickHouse Job description :  We are seeking a highly skilled data engineer with expertise in ClickHouse, Memgraph, or Neo4j to guide our project. You will be responsible for advising...

  • Lead Python Backend Engineer

    3 days ago

    Rajahmundry, Andhra Pradesh, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a skilled Backend Developer with expertise in Python and related frameworks to join our team. The ideal candidate will have hands-on experience designing, developing, and maintaining scalable backend applications and APIs.Key Responsibilities:Develop and enhance backend applications using Python.Design and build RESTful APIs and microservices...

  • Data Engineering Specialist

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Azure Data Engineer Position OverviewWe are seeking an experienced Azure Data Engineer to design, develop, and manage complete end-to-end data pipelines.The ideal candidate will possess strong expertise in building scalable data solutions on Azure, focusing on data transformation, warehousing, and visualization.Key responsibilities include:Designing and...

  • Data Engineering Lead

    7 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 8,71,200 - ₹ 11,48,800

    Senior Data EngineerWe are seeking a seasoned data engineer to lead the development of large-scale data engineering solutions.Key Responsibilities:Design and develop high-quality data engineering solutions using Python, PySpark, and other relevant technologies.Collaborate with cross-functional teams to ensure seamless integration of data engineering...

  • Cloud Data Engineering Professional

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a skilled professional to fill the role of Data Engineer in our organization. As a Data Engineer, you will work closely with our data science team to design and implement complex algorithms that provide unique insights into our data.The ideal candidate will have experience with Python, SQL, and data visualization/exploration...

  • Lead Python Platform Engineer

    4 days ago

    Rajahmundry, Andhra Pradesh, India Persistent Systems Full time

    About Position: We are hiring for Lead Python engineer with hands on experience with Apache Beam, databricks etc.,Role: Lead Python Platform Engineer – Architecture & PerformanceLocation: All PSL LocationsExperience: 3 to 7 YearsJob Type: Full Time EmploymentWhat You'll Do: Architecture and reuse: Design and build a shared component library/SDK for...

  • Freelance Cloud Security Specialist – Python

    3 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Protect your business from cyber threats with expert data engineering services. Our team is dedicated to delivering cloud security, web and mobile testing, and DevSecOps solutions.We seek a highly skilled Freelance Data Engineer to design, develop, and optimize data pipelines using Python and AWS services.The role requires proficiency in pytest for testing,...

  • Cloud Data Engineer

    3 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data Engineer – BFSI DomainWe are seeking a skilled Cloud Data Engineer to work on our client project in the BFSI domain.Collaborate with data science teams to implement advanced analytics solutions and complex algorithms.Design, build, and maintain ETL pipelines for efficient data aggregation and transformation.Use agile development practices to...