Large Scale Data Solutions Developer

2 days ago

Cochin, Kerala, India beBeeDataEngineer Full time ₹ 12,50,000 - ₹ 17,50,000
PySpark Data Engineer Opportunity

We are seeking a highly motivated and experienced PySpark Data Engineer to design, develop, and maintain large-scale data processing solutions in cloud environments.

The ideal candidate will bring hands-on expertise in PySpark, Python, SQL, and real-time data streaming, contributing to the design and implementation of scalable data pipelines.

Key Responsibilities:

  • Design, develop, and optimize data pipelines using PySpark, Spark, and Python.
  • Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources.
  • Develop and maintain Hive queries and ensure seamless data transformations.
  • Write and optimize SQL queries for large datasets.
  • Build, monitor, and support real-time streaming solutions using Apache Kafka.
  • Work on Databricks to create, manage, and optimize data workflows.
  • Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks).
  • Debug, troubleshoot, and optimize code for performance and scalability.
  • Collaborate with cross-functional teams to deliver data-driven solutions.

Required Skills & Qualifications:

  • A minimum of 3–4 years of experience in data engineering with a focus on PySpark and Python.
  • Strong knowledge of Spark, Hive, SQL, and Unix shell scripting.
  • Experience with Databricks in a production environment.
  • Hands-on experience with Azure cloud services (preferably Data Lake, Synapse, Databricks).
  • Experience working with Apache Kafka or other real-time streaming technologies.
  • Strong problem-solving and debugging skills.
  • Excellent written and verbal communication skills.

Nice-to-Have Skills:

  • Exposure to CI/CD pipelines for data solutions.
  • Knowledge of data governance and security best practices.

  • Expert in Large-Scale Data Systems

    2 days ago

    Cochin, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data ArchitectWe are seeking a skilled Data Architect to join our team and contribute to the design, development, and implementation of large-scale data systems.

  • Data Engineer for Large-Scale Data Platforms

    2 weeks ago

    Cochin, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    About the RoleAs a senior data engineer, you will be responsible for designing and implementing large-scale data platforms on Google Cloud.This is a critical role that involves working closely with cross-functional teams to deliver high-quality solutions.Key Responsibilities:Data Pipeline Design: Design robust data pipelines for ingestion, transformation,...

  • Large Scale Predictive Modeling Researcher

    5 days ago

    Cochin, Kerala, India beBeePredictive Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Research OpportunitiesWe are seeking a highly motivated research consultant to assist in our research and development efforts on large-scale user engagement predictive models.The ideal candidate will have prior experience in Deep Learning, Natural Language Processing, and building large-scale prediction and reasoning models.A strong background in applied...

  • Senior IBM iSeries Developer for Large Scale Enterprise Applications

    2 days ago

    Cochin, Kerala, India beBeeDatabase Full time ₹ 20,00,000 - ₹ 35,00,000

    IBM iSeries Expert WantedDescriptionWe are seeking a seasoned Senior IBM iSeries Developer to drive large-scale enterprise application development on the IBM iSeries platform. This highly skilled individual will be responsible for designing, developing, and testing complex applications using RPGLE, CLLE programming, and ILE.ResponsibilitiesApplication...

  • Servicenow Developer for Large-Scale Transformation Project

    19 hours ago

    Cochin, Kerala, India beBeeServicenow Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    About this RoleWe are seeking an experienced developer to support a large-scale ServiceNow transformation project. The focus will be on designing and implementing processes in ServiceNow, leveraging the Order Management product.Key Responsibilities:Enhance existing designs and review identified requirements during UAT phases.Implement ServiceNow Order...

  • Data Solutions Architect

    3 days ago

    Cochin, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key Data Architect RoleAs a seasoned data architect, you will be responsible for designing and implementing large-scale data solutions using cloud-native technologies.Responsibilities:Design Strategy: Develop data architecture blueprints that include data flow diagrams, system integrations, and storage solutions.Cloud Data Platform Development: Lead the...

  • Advanced Cloud Architect

    5 days ago

    Cochin, Kerala, India beBeeSite Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Site Reliability Engineer- ELK ExpertWe are seeking an accomplished Senior Site Reliability Engineer (SRE) with extensive expertise in the ELK stack to assume a leadership role in our Platform Engineering Practice. The ideal candidate will possess 7+ years of experience, including 4+ years specializing in Elasticsearch, Logstash, and Kibana.In this...

  • Data Solutions Architect

    2 days ago

    Cochin, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Solutions ArchitectWe are seeking a skilled and experienced Data Solutions Architect to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems that meet the needs of our business.Key Responsibilities:Design and implement scalable data architectures that meet the...

  • Salesforce Architect for Large Scale Enterprise Programs

    2 days ago

    Cochin, Kerala, India beBeeDevOps Full time ₹ 1,50,00,000 - ₹ 2,01,00,000

    Job Description">We are seeking a seasoned Salesforce architect to spearhead the optimization and governance of our CI/CD processes across multiple Salesforce orgs.This role is critical in enabling package-based deployments, scalable branching strategies, and large-scale Salesforce programs such as Service Cloud and multi-org contact center...

  • HR Business Partner

    1 week ago

    Cochin, Kerala, India beBeeHumanResources Full time ₹ 9,00,000 - ₹ 15,00,000

    We're looking for an HR professional who has hands-on experience in managing large-scale operations and understands the dynamics of a fast-paced, high-volume environment.The ideal candidate must come from a BPO background and have managed end-to-end responsibilities for frontline and mid-level employees.Key Responsibilities:Act as a strategic partner to...