Big Data Developer

2 months ago


Anywhere in IndiaMultiple Locations Risk Resources LLP Full time

Responsibilities :

- Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP

- Define the technical vision and roadmap for big data architecture within the organization

- Architect and implement scalable, high-performance big data pipelines using technologies like MapReduce, Hive, Spark, and BigQuery

- Optimize and troubleshoot complex data processing jobs to ensure efficient data analysis

- Develop and maintain data models for large datasets

- Ensure data quality and security across the big data platform

- Stay up-to-date on the latest advancements in big data technologies and GCP offerings

- Collaborate with cross-functional teams (e.g. , data science, analytics) to understand data needs and deliver solutions

- Communicate effectively with stakeholders at all levels, both technical and non-technical

- Develop and mentor junior engineers within the team

Qualifications :

- Minimum 8 years of experience in developing distributed enterprise applications

- 5+ years of Cloud software development experience with Map-Reduce, Hive, Spark (core, SQL, and PySpark)

- 3-5 years of solid experience with GCP BigQuery and 3 years of experience working on GCP Compute Engine

- Good overall understanding of Google Cloud Platform and its services (3-5 years)

- Solid experience with Google Cloud Dataproc

- Expertise with data structures, data modeling, and software architecture

- Experience in Hadoop and Spark Architecture and its working principles

- Hands-on experience on writing and understanding complex SQL (Hive/PySpark-dataframes), optimizing joins while processing huge amounts of data

- Experience in UNIX shell scripting

Skills :

- Google Cloud Platform (GCP)

- BigQuery, DataProc, Compute Engine

- Apache Spark (core, SQL, PySpark)

- MapReduce, Hive

- Big Data Architecture

- Data Modeling

- SQL (Hive/PySpark-dataframes)

- Software Development (Java, Python preferred)

- Cloud Computing

- Data Security

- Leadership

- Communication

- Teamwork

- Problem-solving

(ref:hirist.tech)
  • Big Data Architect

    3 hours ago


    Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full time

    Responsibilities : Data Ingestion & Processing : Design and build robust data pipelines using tools like Apache Spark, Flink, or Kafka to ingest, transform, and process massive datasets from various sources.Big Data Technologies : Utilize your expertise in big data frameworks like Hadoop, YARN, and HDFS to manage, store, and analyze large volumes of data...

  • PySpark Tech Lead

    2 months ago


    Anywhere in India,Multiple Locations TD Newton & Associates Full time

    Technical Skills :- Extensive experience working on software engineering projects and SDLC- Have worked on various development project as developer and/or lead developer.- Capability to understand and comprehend the solution and create a development framework where all the developers will be contributing.- Should be able to create a Test driven development...

  • Big Data Architect

    1 month ago


    Bangalore,Anywhere in India,Multiple Locations ARR Recruitment Solutions Full time

    About the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...

  • Big Data Architect

    1 month ago


    Bangalore/Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full time

    About the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...

  • GCP Data Architect

    4 weeks ago


    Anywhere in India/Multiple Locations Huquo Full time

    Role : GCP Data Architect Description : As a GCP Data Architect, you will be responsible for architecting enterprise data solutions for migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to...

  • GCP Data Architect

    1 month ago


    Anywhere in India/Multiple Locations, IN Huquo Full time

    Role : GCP Data Architect Description : As a GCP Data Architect, you will be responsible for architecting enterprise data solutions for migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable...


  • Bangalore,Anywhere in India,Multiple Locations Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...


  • Bangalore/Anywhere in India/Multiple Locations, IN Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...


  • Anywhere in India,Multiple Locations Grownex HR Solution Full time

    Role : Lead Big Data Engineer Work Mode : Remote(5 Days working) The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The...


  • Anywhere in India/Multiple Locations, IN Grownex HR Solution Full time

    Role : Lead Big Data EngineerWork Mode : Remote(5 Days working)The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate...

  • ETL Developer

    2 months ago


    Anywhere in India,Multiple Locations Dotflick Solutions Full time

    Job Designation : ETL DeveloperWFH / WFOJob Description :- Work Experience : Overall 3+ years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting solutions with relevant experience.Role & Responsibilities :- To be a Data expert/Architect in implementing solutions using Databases/ETL/DWH/Data Integration/Reporting tools with...

  • ETL Developer

    1 month ago


    Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Job Designation : ETL DeveloperWFH / WFOJob Description :- Work Experience : Overall 3+ years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting solutions with relevant experience.Role & Responsibilities :- To be a Data expert/Architect in implementing solutions using Databases/ETL/DWH/Data Integration/Reporting tools with...

  • Sigmoid Analytics

    2 months ago


    Anywhere in India,Multiple Locations ASTAR DATA LLP Full time

    Job Description : This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Hadoop Administrator

    2 months ago


    Metros,Anywhere in India,Multiple Locations Dotflick Solutions Full time

    Designation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...

  • Hadoop Administrator

    1 month ago


    Metros/Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Designation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...

  • MDM Architect

    2 months ago


    Anywhere in India,Multiple Locations TELL Jobs Full time

    Job Description : - Minimum 8+ years of proven experience and Own and aggressively drive forward MDM, Data Governance, Big Data, and Cloud Data Management- Develops data integration processes using the Informatica platform - Creating business solutions which utilize the CDI platform and ensure high quality and scalable solutions- Work with EA (Enterprise...

  • Senior Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations VAST Consulting Full time

    Job Description : - Should have 5+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- 5+ years of experience in a data engineering role with strong understanding of graph databases, streaming and batch analytics, cloud data platforms, data visualizations and big data processing.- Deep...

  • Sigmoid Analytics

    2 months ago


    Anywhere in India,Multiple Locations ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

  • Data Engineering Lead

    4 weeks ago


    Anywhere in India/Multiple Locations VAST Consulting Full time

    Job Description : - Should have 8+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- Demonstrated leadership experience leading cross-functional teams in the design and implementation of complex data solutions.- Experience in a data engineering role with strong understanding of graph...

  • Big Data Architect

    4 weeks ago


    Metros,Anywhere in India,Multiple Locations Xcel Hire Management Solutions Full time

    Job description : - The decision-making power for data analysis and he/she should also possess the quality of architecting the massive data- Should have skills in big data tools and technologies; it includes technologies like the Hadoop, accumulo, MapReduce, Hive, HBase, panoply and redshift- Overall 10 years of experience as Principal Consultant, Subject...