Senior Cloud Data Specialist

1 week ago

Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 14,00,000
Job Description:

An experienced Data Engineer will be responsible for designing, developing, and maintaining large-scale data processing solutions using PySpark and Python. They will collaborate with cross-functional teams to deliver data-driven solutions.

">
  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot, and optimize code for performance and scalability.
Required Skills & Qualifications:

The ideal candidate will have 3–4 years of experience in data engineering with a focus on PySpark and Python. They will possess strong knowledge of Spark, Hive, SQL, and Unix shell scripting.

  • 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.
  • Ability to work independently in a fast-paced environment and adapt to new technologies quickly.
Nice-to-Have Skills:

The following skills are highly desirable:

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.
  • Experience with Agile/Scrum methodology.

  • Senior Cloud Specialist

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDevops Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    At the forefront of innovation, a leading edge technology firm seeks an accomplished Senior Cloud Specialist to spearhead its cloud infrastructure and automation efforts.Key ResponsibilitiesCloud Infrastructure DesignAutomated Deployment PipelinesContainerized Application ManagementSystem Monitoring and LoggingSecurity Audits and ComplianceHigh Availability...

  • Senior Cloud Data Specialist

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Overview:We are seeking a highly skilled Cloud Architect to lead the design, development, and optimization of large-scale data pipelines and architectures.The ideal candidate is a seasoned data expert with hands-on experience in cloud environments, particularly AWS. This individual will serve as a Cloud Development expert, mentoring and guiding other...

  • Data Engineer for Cloud Solutions

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineering SpecialistWe are seeking a seasoned professional to spearhead the development and deployment of cloud-based data solutions.

  • Senior Data Integration Specialist

    1 week ago

    Gulbarga, Karnataka, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 25,00,000

    Overview:We are seeking a skilled Senior Data Integration Specialist to lead the design and implementation of scalable data pipelines using Azure Data Factory.Key Responsibilities:Design and implement efficient data integration processes across multiple systems, ensuring seamless data flow and optimal performance.Collaborate with cross-functional teams to...

  • Senior Cloud Data Specialist

    1 week ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Profile:Azure data engineer required to work on Data bricks, Azure data factory and PySpark.Proficiency in AWS, Azure, and SAP with expertise over ELT, data modeling, data integration & ingestion, data manipulation & processing.Candidate's Profile:BE/MCA degree with a minimum of 5+ years experience as an Azure data engineer working on Data bricks, Azure...

  • Expert Cloud Data Professional

    1 week ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 14,00,000

    Cloud Data SpecialistDesign, develop, and implement cloud-based data processing solutions.To succeed in this role, you should have 3-5 years of experience in designing and developing scalable data pipelines using AWS services. You should be proficient in programming languages such as Python and have hands-on experience with tools like PySpark and Databricks....

  • Senior Data Engineer

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    About This Role:As a senior data engineer with our innovative team, you will be responsible for designing and implementing highly scalable, reliable, and secure data pipelines on GCP.This is an excellent opportunity to showcase your skills in cloud computing, data engineering, and big data analytics.Design and implement efficient data processing workflows...

  • Data Mapping Specialist

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDataMapping Full time ₹ 9,00,000 - ₹ 15,00,000

    Job Title: Data Mapping SpecialistWe are seeking an experienced Data Mapping Specialist to support the migration of claims data from legacy systems to a cloud-based platform. The ideal candidate will have strong knowledge of property and casualty insurance domain, expertise in SQL, and hands-on experience mapping data between legacy tables and cloud-based...

  • Senior Cloud Data Specialist

    2 weeks ago

    Gulbarga, Karnataka, India beBeeDataEngineering Full time US$ 15,00,000 - US$ 20,00,000

    We drive business transformation by driving clients' success through deep expertise and innovative solutions.Azure Data EngineerMandatory Skills:Expertise in data engineering with AzureProficiency in cloud-based data platformsStrong understanding of data security and complianceWhat We Offer:Opportunities for career growth and developmentA collaborative and...

  • AWS Cloud Engineering Specialist

    2 weeks ago

    Gulbarga, Karnataka, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior AWS Cloud DeveloperWe are seeking an experienced Senior AWS Cloud Developer to collaborate with our team in designing and implementing scalable cloud-based enterprise data solutions.