PySpark Data Engineer

2 weeks ago

Dombivli, Maharashtra, India BLS360 Full time

Role Overview

This is a contract remote role. We are seeking a highly motivated PySpark Data Engineer with 3–4 years of experience in building, optimizing, and maintaining large-scale data processing solutions. The ideal candidate will bring hands-on expertise in PySpark, Python, SQL, and real-time data streaming and will contribute to the design and implementation of scalable data pipelines in cloud environments such as Azure.

·         Location: India. Remote.

·         Job type: Contract

Key Responsibilities

  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.
  • Adhere to best practices for coding, testing, and deployment.

Required Skills & Qualifications

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.

Nice-to-Have Skills

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Cloud Data Engineer

    2 weeks ago

    Dombivli, Maharashtra, India beBeeDataWarehouseEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job Role: Data Warehouse Engineer","Job Summary: We are seeking a highly skilled Data Warehouse Engineer to design, implement, and optimize data warehouses on the Snowflake platform.","Key Responsibilities:","","Design and implement scalable and high-performance data storage solutions using Snowflake features.","Develop and maintain end-to-end data pipelines...

  • Cloud Data Engineer

    2 weeks ago

    Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Engineering LeaderWe are seeking a skilled and experienced Cloud Data Engineering Leader to lead the design, development, and deployment of scalable data pipelines and ETL processes. The successful candidate will have a strong background in Scala, Apache Spark, and Python, as well as experience with cloud-based platforms such as...

  • Chief Data Engineer

    2 weeks ago

    Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    As a Data Architect, you will play a pivotal role in designing and developing scalable data systems.Key ResponsibilitiesInteract with customers to understand their data requirements, utilizing excellent communication skills to provide tailored solutions.Collaborate with cross-functional teams to design, develop, and deploy big data technologies, including...

  • Chief Data Scientist

    2 weeks ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    About the RoleWe are seeking a highly skilled Data Engineer with expertise in Spark and SQL to lead our data team.Key Responsibilities:Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data Integration: Integrate data from various sources, ensuring data quality and...

  • Data Engineering Specialist

    1 week ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 15,74,400 - ₹ 21,16,000

    Data Engineer RoleThis is a technical contributor position ideal for individuals who excel in execution rather than high-level architecture.The role involves delivering under tight deadlines in a fast-paced environment and contributing to the prioritization and phased delivery of large-scale data integrations.A strong background in data ingestion,...

  • AWS Data Engineer- Sagemaker

    2 weeks ago

    Dombivli, Maharashtra, India YASH Technologies Full time

    Primary skillsets : AWS services including Glue, Pyspark, SQL, Databricks, Python Secondary skillset : Any ETL Tool, Github, DevOPs(CI-CD) Mandatory Skill Set: Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applicationsStrong understanding and hands-on experience with AWS services like EC2, S3, EMR, Glue,...

  • AWS Cloud Data Pipeline Specialist

    2 weeks ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:A Data Engineer at a top organization designs and develops scalable data pipelines using AWS services like Glue, S3, and Redshift. This role requires a strong understanding of Python, PySpark, and SQL to build robust ETL processes.Key ResponsibilitiesDesign and implement data pipelines using PySpark, focusing on performance, scalability, and...

  • Data Solutions Architect

    2 weeks ago

    Dombivli, Maharashtra, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title:Cloud Data Engineer Job Description:We are seeking a highly skilled Cloud Data Engineer to design and implement scalable data engineering solutions using Google Cloud Platform (GCP) services and Big Data Analytics.This is an exciting opportunity for professionals passionate about working on advanced cloud-based projects. As a key member of our...

  • Highly Skilled Azure Data Engineer

    1 week ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OpportunityProficient in data engineering with Azure, focusing on Data Bricks/Azure Data Factory/Pyspark implementation.Requires expertise in ELT, Data Modeling, and Data Integration & Ingestion with AWS/Azure/SAP experience.Mastery of Data Manipulation and Processing with proficiency in GITHUB, Actions, Azure DevOps, Databricks/Data factory/SQL...

  • Senior Azure Data Engineering Specialist

    2 weeks ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Sr. Azure Data Engineer RoleWe are seeking a skilled Azure Data Engineer with expertise in modern data engineering tools and platforms within the Azure ecosystem.This role involves working on complex data migration projects, designing and developing end-to-end data pipelines using Azure Data Factory or Synapse Data Factory, and building scalable and secure...