Big Data Platform Technical Lead

2 weeks ago


Chennai, Tamil Nadu, India 1HResource Solutions Full time

Job Title: Senior Data Engineer for Large-Scale Data Integration

Job Description: We are seeking an experienced Senior Data Engineer to lead our big data platform initiatives. The successful candidate will be responsible for designing and implementing large-scale data integration projects using big data technologies such as Hadoop, Spark, and Kafka.

Key Responsibilities:

  • Design and develop large-scale big data platforms using Hadoop, Spark, and Kafka.
  • Work with data architects and engineers to define platform architecture and build necessary infrastructure.
  • Ensure the performance, scalability, and security of the big data platform and troubleshoot any issues that arise.

Requirements:
  • 7-9 years of work experience in a relevant field.
  • Experience with big data processing technologies such as Apache Hadoop, Apache Spark, or Apache Kafka.
  • Understanding of distributed computing concepts such as MapReduce, Spark RDDs, or Apache Flink data streams.
  • Familiarity with big data storage solutions such as HDFS, Amazon S3, or Azure Data Lake Storage.
  • Excellent communication skills and ability to communicate complex technical information to non-technical stakeholders.


  • Big Data Lead

    4 weeks ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Job Description:As a Big Data Lead at Virtusa, you will be responsible for designing, building, and supporting data applications using Spark, Sqoop, and Hive. You will work with large data sets and high-capacity big data processing platforms, leveraging your expertise in Unix and Shell scripting. Your advanced knowledge of the Hadoop ecosystem and its...


  • Chennai, Tamil Nadu, India NR Consulting - India Full time

    We are seeking a highly skilled Senior Architect with extensive experience in leading large-scale Big Data migration projects to Google Cloud Platform (GCP). Your expertise in GCP technologies, Big Data technologies, Python scripting, and database migration will be crucial in ensuring the successful transition from Hadoop to BigQuery.Roles &...


  • Chennai, Tamil Nadu, India Databricks Full time

    Job Summary:We are seeking a highly skilled Big Data Solutions Expert to join our Professional Services team at Databricks. As a key member of our team, you will work closely with customers to deliver complex big data projects using the Databricks platform.About the Role:As a Big Data Solutions Expert, you will be responsible for providing data engineering,...


  • Chennai, Tamil Nadu, India FIS Full time

    About the RoleFIS is seeking a talented Big Data Analytics Engineer to join our team. As a Big Data Analytics Engineer, you will design, architect, and help maintain enterprise solutions on the big data analytics platform.Key ResponsibilitiesDesign, architect, and help maintain enterprise solutions on the big data analytics platform.Lead systems...


  • Chennai, Tamil Nadu, India TapTalent Full time

    Job Title: Big Data Cluster AdministratorJob Summary:We are seeking a highly skilled Big Data Cluster Administrator to join our team at TapTalent. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining large-scale big data environments on Linux platforms.Key Responsibilities:Administer and govern...


  • Chennai, Tamil Nadu, India Databricks Full time

    Job Summary:As a Solutions Architect (Big Data) at Databricks, you will work with customers on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical tasks to...

  • Big Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India ZF Group Full time

    Job Title: Big Data DeveloperJob Summary:At ZF Group, we are searching for a skilled Big Data Developer to contribute to the success of our organization. Responsibilities:- Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5 years in Big Data technologies and platforms.- Strong understanding of distributed...


  • Chennai, Tamil Nadu, India Selsoftinc Full time

    Job Description:- Design and implement scalable big data architectures on Microsoft Azure and Azure Fabric to meet business requirements and handle large volumes of data efficiently and securely.- Develop and manage data pipelines for ingesting, processing, and analyzing large datasets, ensuring data quality and integrity.- Collaborate with data scientists,...


  • Chennai, Tamil Nadu, India Databricks Full time

    We are seeking an experienced Big Data Migration Strategist to join our team at Databricks. As a key member of our Professional Services team, you will work with customers on short to medium-term engagements to help them overcome their big data challenges using the Databricks platform.Job DescriptionIn this role, you will provide data engineering, data...


  • Chennai, Tamil Nadu, India NR Consulting - India Full time

    Job Title: Senior Big Data ArchitectAbout the Role:NR Consulting - India is seeking a highly skilled Senior Big Data Architect to lead our Hadoop to BigQuery migration projects. As a key team member, you will be responsible for designing and implementing scalable solutions that leverage Google Cloud Platform (GCP) technologies, specifically focusing on...


  • Chennai, Tamil Nadu, India FIS Full time

    About the RoleFIS is seeking a skilled Big Data Analytics Engineer to join our team. As a key member of our Core Engineering team, you will be responsible for designing, architecting, and maintaining enterprise solutions on our big data analytics platform.Key ResponsibilitiesDesign and implement big data analytics solutions using Hadoop, Python, Spark, and...


  • Chennai, Tamil Nadu, India Databricks Full time

    Job SummaryWe are seeking a skilled Big Data Migration Strategist to join our team at Databricks. As a key member of our Professional Services team, you will work closely with customers to deliver complex big data projects using the Databricks platform.About the RoleKey ResponsibilitiesDesign and implement data migration strategies for customers moving to...


  • Chennai, Tamil Nadu, India Databricks Full time

    Job SummaryAs a Migrations Architect at Databricks, you will work with customers on short to medium-term engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical tasks to help customers get...


  • Chennai, Tamil Nadu, India Databricks Full time

    Job Summary:As a Migrations Architect at Databricks, you will be responsible for leading complex migrations to the cloud, working closely with customers to understand their big data challenges and providing data engineering, data science, and cloud technology projects that require integrating with client systems. You will work with engagement managers to...

  • Big Data Developer

    4 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Big Data DeveloperAbout the Role:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and deploying scalable Big Data applications using Hadoop ecosystem technologies.Key Responsibilities:Design and develop scalable Big Data applications...

  • Big Data Developer

    4 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Big Data DeveloperJob Summary:RiskInsight Consulting Pvt Ltd is seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will design, develop, and deploy scalable Big Data applications using Apache Spark.Responsibilities:Data Ingestion: Implement data ingestion processes from various data sources to the Big Data...

  • Big Data Lead

    1 month ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Job Title: Big Data LeadJob Summary:We are seeking a highly skilled Big Data Lead to join our team at Virtusa. The successful candidate will have a strong background in designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Develop components, application interfaces, and solution enablers while ensuring...

  • Big Data Developer

    4 weeks ago


    Chennai, Tamil Nadu, India Saransh Inc Full time

    Job Description:Saransh Inc is seeking a highly skilled Big Data Developer to join our team. The ideal candidate will have a strong background in Java and experience with Big Data technologies such as Spark and Hive.Responsibilities:Design and implement scalable fault-tolerant ETL pipelines on Big Data platforms.Work with the onsite development team to...


  • Chennai, Tamil Nadu, India Gainwell Technologies Full time

    SummaryWe are seeking a highly skilled Data Platform Architect to lead our product development team in designing and implementing a cloud-based data platform architecture that will power BI and advanced analytics at Gainwell Technologies. The ideal candidate will have industry-leading programming skills and established knowledge of implementing, designing,...

  • Big Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Job Title: Big Data - Tech LeadJob Summary:We are seeking a highly skilled Big Data - Tech Lead to join our team at Virtusa. The successful candidate will be responsible for designing, building, and deploying Big Data solutions.Responsibilities:Design and develop Big Data pipelines and REST APIs using Scala or Java.Develop robust code in Scala and have a...