Big Data Engineering Opportunities

14 hours ago

Coimbatore, Tamil Nadu, India beBeeDataEngineering Full time

Job Title: Data Engineering Specialist

Description:

The role of a data engineering specialist involves leading the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks). This position requires strong hands-on programming experience in Scala, with a deep understanding of functional programming concepts.

Additionally, this individual will be responsible for developing and maintaining data processing workflows using PySpark and Python. The ideal candidate will have extensive experience with Apache Spark, including Spark SQL, Spark Streaming, and optimization techniques.

As a data engineering specialist, you will collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver robust data solutions. You will also be responsible for architecting and implementing data ingestion, transformation, and integration solutions for structured and unstructured data.

Other key responsibilities include optimizing Spark jobs for performance and cost efficiency on cloud platforms, leading, mentoring, and guiding a team of data engineers, ensuring best practices in coding, testing, and deployment.

Required Skills:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 10+ years of professional experience in data engineering.
  • Strong programming skills in Scala and Python.
  • Extensive experience with Apache Spark.
  • Proficiency in distributed computing and big data architectures.
  • Experience working with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with data storage technologies like HDFS, S3, Delta Lake, and relational/non-relational databases.

Why Choose This Role?

This is an excellent opportunity to work on challenging projects and develop your skills in data engineering. As a data engineering specialist, you will have the chance to lead a team of engineers and mentor them in best practices.

What We Offer:

We offer a competitive salary package, opportunities for career growth, and a collaborative work environment. If you are a motivated and experienced data engineer looking for a new challenge, apply now

  • Senior Big Data Engineer Position

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Engineering OpportunityWe are seeking a highly skilled Big Data Engineer to design and develop scalable data processing systems using cutting-edge technologies.Design and implement large-scale data processing architectures using Big Data tools and technologiesCollaborate with cross-functional teams to integrate data solutions with existing...

  • Big Data Expert

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 35,00,000

    Job Title: Big Data ExpertPrimary Skills:Big Data Analytics, Machine Learning, Data ScienceCloud Computing, Artificial Intelligence, Data EngineeringKey Responsibilities:Design and develop complex data pipelines utilizing big data analytics frameworks.Orchestrate large-scale data workflows ensuring seamless integration across cloud-based services.Develop...

  • Senior Data Engineer – Big Data Platform

    6 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineering Full time US$ 15,00,000 - US$ 18,00,000

    Job DescriptionWe are seeking a highly skilled and experienced technical leader to join our team. As a Technical Lead, you will be responsible for building a scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This is a challenging and exciting...

  • Big Data Engineer

    5 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking an experienced Databricks professional to lead our big data initiatives. The ideal candidate will have a strong background in Python, Spark, and cloud technologies.

  • Big Data Engineer

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 21,00,000

    Job Opportunity">Job Description">">Design, build, and optimize data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.">Construct infrastructure for efficient ETL processes from various sources and storage systems.">Lead the implementation of algorithms and prototypes to transform raw data into useful...

  • Senior Big Data Solutions Specialist

    5 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team and design scalable data processing solutions using Azure Databricks. The ideal candidate will have a strong understanding of data warehousing concepts and proficiency with big data tools and frameworks such as Hadoop and Spark.

  • Big Data Developer

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data Solutions EngineerLocation : Chennai/Bangalore/Hyderabad/Coimbatore/ PuneRole Summary:We are seeking a skilled Data Solutions Engineer with hands-on experience in designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. The ideal candidate will have expertise in big...

  • Senior Big Data Engineer

    6 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time US$ 50,000 - US$ 75,000

    Job Title: Hadoop AdminThis is a challenging role that requires the skills to build and manage complex systems.The ideal candidate should have experience in handling large datasets, ensuring high performance, and troubleshooting issues. Key responsibilities include:Designing, implementing, and managing data processing pipelines using Hadoop...

  • Big Data Solutions Architect

    16 hours ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Big Data Solutions ArchitectThis is a leadership role that requires expertise in designing and implementing big data solutions using Hadoop v2, Map Reduce, HDFS, Sqoop, and Spark-Streaming.Develop and maintain large-scale data processing systems using Apache Storm or Spark-Streaming.Collaborate with cross-functional teams to integrate data from multiple...

  • Big Data Specialist

    6 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock Data Potential">Design and Develop Scalable Big Data SolutionsDevelop and Maintain Complex Data PipelinesCollaborate with Stakeholders to Identify Business Needs and RequirementsWe are seeking an experienced specialist to help our clients unlock the power of their data and make informed business decisions.">Analyzing Large Datasets and Visualizing...