Pyspark Data Engineer

2 weeks ago

Hubli, Karnataka, India BLS360 Full time
Role OverviewThis is a contract remote role.
We are seeking a highly motivated Py Spark Data Engineer with 3–4 years of experience in building, optimizing, and maintaining large-scale data processing solutions.
The ideal candidate will bring hands-on expertise in Py Spark, Python, SQL, and real-time data streaming and will contribute to the design and implementation of scalable data pipelines in cloud environments such as Azure.·         Location: India.
Remote.·         Job type: ContractKey ResponsibilitiesDesign, develop, and optimize data pipelines using Py Spark, Spark, and Python.Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.Develop and maintain Hive queries and ensure seamless data transformations.Write and optimize SQL queries for large datasets.Build, monitor, and support real-time streaming solutions using Apache Kafka.Work on Databricks to create, manage, and optimize data workflows.Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).Debug, troubleshoot, and optimize code for performance and scalability.Collaborate with cross-functional teams to deliver data-driven solutions.Adhere to best practices for coding, testing, and deployment.Required Skills & Qualifications3–4 years of experience in data engineering with a focus on Py Spark and Python.Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.Experience with Databricks in a production environment.Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).Experience working with Apache Kafka or other real-time streaming technologies.Strong problem-solving and debugging skills.Excellent written and verbal communication skills.Ability to work independently in a fast-paced environment and adapt to new technologies quickly.Nice-to-Have SkillsExposure to CI/CD pipelines for data solutions.Knowledge of data governance and security best practices.Experience with Agile/Scrum methodology.

  • Data Engineering Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000

    Job Title: Data Engineering SpecialistJob Description:We are seeking an experienced Data Engineer with hands-on expertise in Python and Pyspark to join our team. As a key member, you will be responsible for implementing a data-driven solution for a large retailer.Required Skills & Qualifications:5+ years of experience as a Data EngineerExpertise in Python,...

  • Data Engineering Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeAutomation Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Automation ProfessionalWe are seeking a highly skilled and experienced data automation specialist to deliver high-quality solutions.As a data automation expert, you will be responsible for designing and implementing automation frameworks to test large-scale enterprise applications. Your expertise in data engineering, data warehouse testing, and quality...

  • Data Management Solutions Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data EngineerWelcome to our organization, where we're shaping the future of data management.As a seasoned Data Engineer, you'll lead our team in implementing cutting-edge infrastructure solutions using code and provide strategic guidance on Microsoft Azure technologies. With 5-7 years of experience, you'll integrate and automate standardized Azure...

  • Ai Security Engineer

    3 weeks ago

    Hubli, Karnataka, India NTT DATA Full time

    Req ID 338875 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AI Security Engineer - Shared Security Services Engineering to join our team in Banaglore Karn taka IN-KA India ...

  • Data Engineer

    2 weeks ago

    Hubli, Karnataka, India Gala Intelligence Full time

    We're looking for an entrepreneurial, passionate, and driven Data Engineer to join Startup Gala Intelligence backed by Navneet Tech Venture situated in Ahmedabad. As we're building our technology platform from scratch, you'll have the unique opportunity to shape our technology vision, architecture, and engineering culture right from the ground up. You'll...

  • Data Engineer

    4 weeks ago

    Hubli, Karnataka, India Lenity Health Full time

    Role Overview Location: Hebbal, Bengaluru Work Mode: Monday to Friday | On-site Work Time: 2pm - 11pm Compensation: ₹15-20 LPA (negotiable based on experience) Experience Level: 3+ years About Lenity Health The healthcare industry operates on systems so outdated, that it clogs the flow of innovation and efficient care coordination. These...

  • Data Engineering Expert

    2 weeks ago

    Hubli, Karnataka, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 21,00,000

    About the RoleWe are seeking a highly skilled data engineer to design, build, and optimize scalable data pipelines and lakehouse architectures.As a senior data engineer, you will work closely with cross-functional teams to provide thought leadership, deliver robust, secure, and high-performance data solutions that empower analytics and data science...

  • Senior Data Engineer

    2 weeks ago

    Hubli, Karnataka, India Deltacubes Full time

    Job description:• Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data. This includes batch and real-time processing (in google cloud)• Build large and complex datasets based on business requirements• Construct 'big data' pipeline architecture• Identify opportunities for data acquisition...

  • Senior Cloud Data Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeCloudEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Data Engineer - Cloud InfrastructureWe are seeking a seasoned Senior Data Engineer to lead our cloud infrastructure initiatives on AWS. As a key member of our team, you will be responsible for designing, developing, and deploying end-to-end data pipelines using AWS services.This is an exceptional opportunity to leverage your technical expertise in...

  • Time-Series Forecasting Expert

    2 weeks ago

    Hubli, Karnataka, India beBeeDataScientist Full time US$ 1,20,000 - US$ 1,40,000

    The Role:We are seeking an experienced data scientist to lead the development and optimization of our forecasting and measurement & verification platform.This platform supports forecasting and M&V for approximately 3 million distributed energy devices at once.As a senior member of the forecasting team, you will collaborate closely with data engineers,...