Big data specialist

1 month ago

Mumbai, India Deloitte Full time
We are looking for Candidates who are having experience in Big Data.
Experience Required: 3+ years.
Location: PAN India
Responsibilities:
- Design, develop and deploy solutions using different tools, design principles and conventions.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources and ‘big data’ technologies.
- Optimize data ingestion and processing performance by tuning configuration parameters, optimizing SQL queries, and implementing parallel processing techniques.
- Monitor pipeline performance and resource utilization to identify bottlenecks and optimize system resources allocation.
- Set up monitoring and alerting systems to track pipeline health, detect anomalies, and notify stakeholders of potential issues or failures.
- Configure logging and metrics collection to facilitate troubleshooting and performance analysis.
- Understand existing processes and facilitate change requirements as part of a structured change control process.
- Maintain proper documentation for the solutions, test procedures and scenarios during UAT and Production phase.
- Understand and implement Pipeline Development, Data Quality and Governance, Monitoring and Alerting, Data Virtualization and Query Optimization, Data Source Integration, Data Catalog Management, Security and Access Control, Integration with Applications and Ecosystems, Data Ingestion and Management
- Coordinate with process owners and business to understand the as-is process and design the automation process flow.
- Produce high-quality code resulting from knowledge of the latest frameworks, code peer review, and automated unit test scripts.
- Collaborate with other developers and team members.

  • Big Data Specialist

    2 months ago

    Mumbai, India Deloitte Full time

    We are looking for Candidates who are having experience in Big Data.Experience Required: 3+ years.Location: PAN IndiaResponsibilities:- Design, develop and deploy solutions using different tools, design principles and conventions.- Assemble large, complex data sets that meet functional / non-functional business requirements.- Identify, design, and implement...

  • Big Data Specialist

    3 months ago

    mumbai, India Deloitte Full time

    We are looking for Candidates who are having experience in Big Data.Experience Required: 3+ years.Location: PAN IndiaResponsibilities:Design, develop and deploy solutions using different tools, design principles and conventions.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement...

  • Big Data SME

    6 days ago

    Mumbai, India Tech Consulting Full time

    **Onsite Opportunity- In-Office**Mumbai, IndiaOur company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants’ chances of succeeding on projects. We are looking for a senior...

  • Big Data SME

    1 week ago

    Mumbai, India Tech Consulting Full time

    **Onsite Opportunity- In-Office** Mumbai, India Our company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants’ chances of succeeding on projects. We are looking for...

  • Big Data Engineer

    4 weeks ago

    navi mumbai, India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Big Data Developer

    1 month ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time

    Job Role: Big Data DeveloperWe are looking for a qualified Big Data Developer to join our team at Tata Consultancy Services.Responsibilities:Ingest data from diverse sources and develop ETL jobs using Spark, PySpark, Hive, and HBase.Perform impact analysis and provide estimates.Oversee end-to-end deliverables.Create project plans and work on implementation...

  • Big Data QA

    1 month ago

    Mumbai, India Brainhunter Recruiting Pvt Ltd Full time

    Job Title: Big Data QA Engineer We are seeking a highly skilled and motivated Big Data QA Engineer with expertise in automation testing using Java or Python programming languages. The ideal candidate should possess a strong background in data validation, data verification, PySpark, pipeline monitoring, software...

  • Big Data SME

    1 week ago

    Mumbai Metropolitan Region, India Tech Consulting Full time

    **Onsite Opportunity- In-Office** Mumbai, India Our company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants’ chances of succeeding on projects. We are looking for a...

  • Big Data SME

    1 week ago

    Mumbai Metropolitan Region, India Tech Consulting Full time

    **Onsite Opportunity- In-Office**Mumbai, IndiaOur company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants’ chances of succeeding on projects. We are looking for a senior...

  • Big Data Engineer

    2 months ago

    Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, India GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at GAIUS HYPERLOCAL PRIVATE LIMITED. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions.Key Responsibilities:Design and develop scalable big data architectures and pipelines.Develop...

  • Big Data Engineer

    4 weeks ago

    Navi Mumbai, India Pert Telecom Solutions Full time

    Job Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Big data engineer

    5 days ago

    Mumbai, India Tata Consultancy Services Full time

    Role ; Big Data engineer Location : Pune, Chennai, Mumbai Exp : 3-6 Year Required Technical Skill Set** Hadoop, Python, Py Spark, HIVE Must-Have** · Hands-on experience of Hadoop, Python, Py Spark, Hive, Big Data Eco System Tools. · Should be able to develop, tweak queries and work on performance enhancement. · Solid understanding of...

  • Big Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Novo Tree Minds Full time

    Job Title: Data EngineerJob Description:We are seeking an experienced Data Engineer to join our team at Novo Tree Minds. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems.Key Responsibilities:Data Ingestion: Design and implement data ingestion pipelines to handle large volumes of data from various...

  • Data Scientist with Big Data Expertise

    7 days ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time

    About the RoleWe are seeking an experienced Data Scientist to join our team as a Big Data Engineer at Tata Consultancy Services. This role involves designing, developing, and maintaining large-scale data processing systems using big data technologies.

  • Big Data engineer

    6 days ago

    Mumbai, India Tata Consultancy Services Full time

    Role ; Big Data engineerLocation : Pune, Chennai, MumbaiExp : 3-6 YearRequired Technical Skill Set** Hadoop, Python, PySpark, HIVEMust-Have** · Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. · Should be able to develop, tweak queries and work on performance enhancement. · Solid understanding of object-oriented programming...

  • Big Data engineer

    1 week ago

    Mumbai, India Tata Consultancy Services Full time

    Role ; Big Data engineer Location : Pune, Chennai, Mumbai Exp : 3-6 Year Required Technical Skill Set** Hadoop, Python, PySpark, HIVE Must-Have** · Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. · Should be able to develop, tweak queries and work on performance enhancement. · Solid understanding of object-oriented...

  • Big Data engineer

    1 week ago

    Mumbai, India Tata Consultancy Services Full time

    Role ; Big Data engineerLocation : Pune, Chennai, MumbaiExp : 3-6 YearRequired Technical Skill Set** Hadoop, Python, PySpark, HIVEMust-Have** · Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. · Should be able to develop, tweak queries and work on performance enhancement. · Solid understanding of object-oriented programming...

  • Big data engineer

    1 week ago

    Mumbai, India Tata Consultancy Services Full time

    Role ; Big Data engineerLocation : Pune, Chennai, MumbaiExp : 3-6 YearRequired Technical Skill Set** Hadoop, Python, Py Spark, HIVEMust-Have**· Hands-on experience of Hadoop, Python, Py Spark, Hive, Big Data Eco System Tools. · Should be able to develop, tweak queries and work on performance enhancement. · Solid understanding of object-oriented...

  • Data Center Technical Specialist

    3 weeks ago

    Mumbai, Maharashtra, India NTT DATA Full time

    About the Role">We are seeking an experienced Data Center Technical Specialist to join our team. In this role, you will be responsible for ensuring that assigned infrastructure at client sites is configured, installed, tested, and operational.Key Responsibilities:

  • Big Data Developer

    4 months ago

    Mumbai, India Snaphunt Full time

    The OfferWork within a company with a solid track record of successExcellent career development opportunitiesGreat work environmentThe JobDesign, develop, and maintain scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.Work extensively with the Kafka and Hadoop ecosystem, including HDFS, Hive, and other related...