Big Data Engineer

1 week ago

Coimbatore, Tamil Nadu, India Rosemallow Technologies Full time US$ 90,000 - US$ 1,20,000 per year

Mandate Skills : Apache spark, hive, Hadoop, spark, scala, Databricks.

Job Description :

The Role :

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.

  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.

  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.

  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI/ML transformations.

  • Creating innovative data validation methods and data analysis tools.

  • Ensuring compliance with data governance and security policies.

  • Interpreting data trends and patterns to establish operational alerts.

  • Developing analytical tools, programs, and reporting mechanisms.

  • Conducting complex data analysis and presenting results effectively.

  • Preparing data for prescriptive and predictive modeling.

  • Continuously exploring opportunities to enhance data quality and reliability.

  • Applying strong programming and problem-solving skills to develop scalable solutions.

Requirements :

  • Experience in the Big Data technologies (Hadoop, Spark, Nifi, Impala).

  • 5+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.

  • High proficiency in Scala/Java and Spark for applied large-scale data processing.

  • Expertise with big data technologies, including Spark, Data Lake, and Hive.

  • Senior Big Data Engineer Position

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Engineering OpportunityWe are seeking a highly skilled Big Data Engineer to design and develop scalable data processing systems using cutting-edge technologies.Design and implement large-scale data processing architectures using Big Data tools and technologiesCollaborate with cross-functional teams to integrate data solutions with existing...

  • Big Data Engineer

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking an experienced Databricks professional to lead our big data initiatives. The ideal candidate will have a strong background in Python, Spark, and cloud technologies.

  • Data Scientist – Big Data

    7 days ago

    Coimbatore, Tamil Nadu, India beBeeDataiku Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Platform Administrator JobJob Description:As a Big Data Platform Administrator, you will be responsible for managing the day-to-day operations of our big data platform. You will administer and monitor Big Data Platform components such as Hadoop, Hive, HBase, and BigSQL.You will support Technical and Application team requests for data copies across...

  • Big Data Expert

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 35,00,000

    Job Title: Big Data ExpertPrimary Skills:Big Data Analytics, Machine Learning, Data ScienceCloud Computing, Artificial Intelligence, Data EngineeringKey Responsibilities:Design and develop complex data pipelines utilizing big data analytics frameworks.Orchestrate large-scale data workflows ensuring seamless integration across cloud-based services.Develop...

  • Senior Big Data Expert

    7 days ago

    Coimbatore, Tamil Nadu, India beBeeDataDeveloper Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineering Specialist">Job OverviewWe are seeking a skilled Big Data Developer to join our delivery team, with a dual focus on hands-on project support and mentoring junior engineers.This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation...

  • Senior Big Data Solutions Specialist

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team and design scalable data processing solutions using Azure Databricks. The ideal candidate will have a strong understanding of data warehousing concepts and proficiency with big data tools and frameworks such as Hadoop and Spark.

  • Big Data Engineering Opportunities

    1 week ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineering Full time

    Job Title: Data Engineering SpecialistDescription:The role of a data engineering specialist involves leading the design, development, and deployment of scalable data pipelines and ETL processes using Scala and Apache Spark (Databricks). This position requires strong hands-on programming experience in Scala, with a deep understanding of functional programming...

  • Big Data Engineer

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 21,00,000

    Job Opportunity">Job Description">">Design, build, and optimize data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.">Construct infrastructure for efficient ETL processes from various sources and storage systems.">Lead the implementation of algorithms and prototypes to transform raw data into useful...

  • Expert Big Data Solutions Architect

    5 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Transforming Enterprises through Data-Driven InnovationWe empower clients to build connected AI-powered products by streamlining product development and maximizing platform ROI. Our experience-centric approach drives business outcomes.In strengthening our healthcare offerings, we have acquired a company that enhances our domain expertise and positions us to...

  • Big Data Solutions Architect

    6 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,000 - ₹ 28,00,000

    Data Engineering Specialist">Design and implement scalable data processing systems using Azure Databricks to optimize business outcomes.Maintain robust data pipelines that ingest data from various sources, ensuring seamless data flow.Optimize data storage and retrieval processes for efficiency and performance.Ensure data quality and integrity throughout the...