Big Data Developer

2 days ago

Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000
Job Title: Data Solutions Engineer

Location : Chennai/Bangalore/Hyderabad/Coimbatore/ Pune

Role Summary:

We are seeking a skilled Data Solutions Engineer with hands-on experience in designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. The ideal candidate will have expertise in big data frameworks, distributed computing, and cloud platforms.

Key Responsibilities:

  • Develop and manage data pipelines using PySpark on Databricks.
  • Implement ETL/ELT processes to process structured and unstructured data at scale.
  • Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks.

Databricks Expertise:

  • Experience in setting up and managing Databricks Workspaces, Clusters, and Jobs.
  • Familiarity with Databricks MLflow for machine learning workflows is a plus.

Cloud Platforms:

  • Expertise in deploying Databricks solutions Azure (e.g., Data Lake, Synapse).
  • Knowledge of Kubernetes for managing containerized workloads is advantageous.

Database Knowledge:

  • Experience with both SQL (e.g., PostgreSQL, SQL Server) and NoSQL databases (e.g., MongoDB, Cosmos DB).

Requirements:

  • 4+ years of experience in data engineering or distributed systems development.
  • Strong programming skills in Python and PySpark.
  • Hands-on experience with Databricks and its ecosystem, including Delta Lake and Databricks SQL.

Education Requirements:

  • A Bachelors Degree in Computer Science, Data Engineering, or a related field is preferred.
  • Relevant certifications in Databricks, PySpark, or cloud platforms are highly desirable.

  • Big Data Specialist

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock Data Potential">Design and Develop Scalable Big Data SolutionsDevelop and Maintain Complex Data PipelinesCollaborate with Stakeholders to Identify Business Needs and RequirementsWe are seeking an experienced specialist to help our clients unlock the power of their data and make informed business decisions.">Analyzing Large Datasets and Visualizing...

  • Big Data Engineer

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking an experienced Databricks professional to lead our big data initiatives. The ideal candidate will have a strong background in Python, Spark, and cloud technologies.

  • Senior Big Data Solutions Specialist

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team and design scalable data processing solutions using Azure Databricks. The ideal candidate will have a strong understanding of data warehousing concepts and proficiency with big data tools and frameworks such as Hadoop and Spark.

  • Big Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 21,00,000

    Job Opportunity">Job Description">">Design, build, and optimize data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.">Construct infrastructure for efficient ETL processes from various sources and storage systems.">Lead the implementation of algorithms and prototypes to transform raw data into useful...

  • Senior Big Data Delivery Expert

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data Delivery ExpertRole Overview:We are seeking a seasoned expert in managing large-scale projects within big data and analytics environments, particularly on Databricks.The ideal candidate will have a proven track record of delivering complex technical projects on time, while ensuring client satisfaction and seamless execution.Key...

  • Senior Big Data Engineer

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time US$ 50,000 - US$ 75,000

    Job Title: Hadoop AdminThis is a challenging role that requires the skills to build and manage complex systems.The ideal candidate should have experience in handling large datasets, ensuring high performance, and troubleshooting issues. Key responsibilities include:Designing, implementing, and managing data processing pipelines using Hadoop...

  • Senior Data Engineer – Big Data Platform

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineering Full time US$ 15,00,000 - US$ 18,00,000

    Job DescriptionWe are seeking a highly skilled and experienced technical leader to join our team. As a Technical Lead, you will be responsible for building a scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This is a challenging and exciting...

  • Highly skilled Data Solutions Architect required to design and implement scalable big data systems

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleBig Data Solutions ArchitectLocation: Coimbatore, IndiaEmployment Type: Full-Time Permanent with ClientNotice Period: Immediate to 30 DaysExperience: 5 to 12 YearsYou will be responsible for designing and implementing scalable big data systems, developing real-time processing solutions, and optimizing data workflows across multiple platforms.The...

  • Big Data Engineer

    7 hours ago

    Coimbatore, Tamil Nadu, India Rosemallow Technologies Full time

    Job DescriptionRESPONSIBILITIES:- Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.- Constructing infrastructure for efficient ETL processes from various sources and storage systems.- Leading the implementation of algorithms and prototypes to transform raw data into useful...

  • Data System Developer

    6 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineer Role\As a Data Engineer, you play a pivotal part in designing, developing, and maintaining robust data systems. Collaborating with cross-functional teams ensures high-quality data standards are met by leveraging expertise in data engineering, architecture, pipeline creation, and big data technologies.\Main Responsibilities\Understand the...