Senior Big Data Professional

1 week ago


Mumbai, Maharashtra, India JMJ CONSULTANTS Full time
Job Overview

JMJ Consultants is seeking a talented Senior Data Engineer to lead the design and development of scalable data pipelines using PySpark in our Mumbai, Andheri East office.

This role involves working closely with cross-functional teams to build and enhance data solutions, ensuring seamless data flow across systems while adhering to best practices in performance, security, and scalability.

Estimated Salary: ₹12-14 LPA

About Us: JMJ Consultants is a leading consulting firm that provides expert advice on various aspects of business operations.

Responsibilities:

  • Design, develop, and maintain data pipelines using PySpark for large-scale data processing.
  • Perform API Integration to connect various systems, ensuring smooth data exchange and real-time data flow.
  • Develop and maintain reliable ETL processes to ensure the accuracy, consistency, and quality of data.
  • Implement Kafka for real-time streaming and data ingestion to handle large volumes of data.
  • Work with databases, particularly MySQL, to store, manage, and optimize data storage solutions.
  • Utilize AWS cloud infrastructure for deploying and managing scalable data solutions.
  • Develop and maintain web applications and services using Django and Flask for data management and integration purposes.
  • Collaborate with the DevOps team to implement CI/CD pipelines using GitHub for version control, testing, and deployment.
  • Monitor data systems for performance, troubleshoot issues and implement best practices for data security and governance.
  • Collaborate with other engineers, data scientists, and product teams to define and deliver data-driven solutions.
  • Develop and manage Web Crawlers to gather structured data from various web sources for integration into internal systems.
  • Design and implement Mobile Crawlers to extract data from mobile apps and APIs, ensuring seamless integration with backend systems.

Requirements:

  • Over 2 years of experience in designing, developing, and maintaining scalable data pipelines using PySpark.
  • Strong proficiency in Python for data engineering and automation tasks.
  • Experience integrating third-party APIs and building APIs for data exchange.
  • Hands-on experience with PySpark for distributed data processing and Kafka for real-time data streaming.
  • Proficiency in MySQL for relational database management, including writing complex queries and optimizing performance.
  • Experience with Django and Flask for building web applications and RESTful services.
  • Proficient in using GitHub for source code management and collaboration.
  • Knowledge of AWS services like S3, EC2, RDS, Lambda, etc., for data storage, processing, and infrastructure management.
  • Familiarity with best practices in data security, compliance, and governance.


  • Mumbai, Maharashtra, India Tech Consulting Full time

    Located in the heart of Mumbai, India, Tech Consulting is seeking a highly skilled Senior Big Data Developer to lead our team of experts. With a competitive salary range of $120,000 - $180,000 per annum, this role offers an exciting opportunity for individuals looking to advance their careers in the IT industry.Job Description:We are searching for a talented...


  • Mumbai, Maharashtra, India Matrix Full time

    Job OverviewWe are seeking a highly skilled Senior Developer to join our team, responsible for designing and delivering technology solutions for transaction monitoring, customer activity review, screening, risk ranking, and optimization of scenarios.About the RoleDefine and develop strategic solutions, leveraging expertise in big data technologies and...

  • Big Data Team Lead

    1 month ago


    Mumbai, Maharashtra, India Cloud Counselage Pvt Ltd Full time

    About Cloud Counselage Pvt LtdWe are a leading organization in the industry, focused on leveraging data to drive business growth. Our team is dedicated to delivering innovative solutions that meet the evolving needs of our clients.Salary and BenefitsAs a Senior Data Architecture Manager at Cloud Counselage Pvt Ltd, you can expect an attractive compensation...


  • Mumbai, Maharashtra, India Novo Tree Minds Full time

    Job DescriptionAt Novo Tree Minds, we are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering group, you will play a critical role in designing, building, and maintaining our big data infrastructure.Key Responsibilities:Design and implement end-to-end data pipelines using Hadoop, Spark, and other big data...


  • Mumbai, Maharashtra, India Larsen & Toubro Full time

    Larsen & Toubro seeks an accomplished Data Analytics Professional to join our team. We offer a competitive salary of $120,000 per annum.About the Role:The ideal candidate will have 11-14 years of experience in data analysis and possess excellent interpersonal skills. They should be able to analyze big data, identify trends, and develop predictive models...


  • Mumbai, Maharashtra, India IDFC FIRST Bank Full time

    IDFC FIRST Bank is seeking a highly skilled Senior Data Engineering Professional to join our team. Salary: ₹1,200,000 - ₹1,800,000 per annum.Job Description:We are looking for an experienced data engineer who can develop and maintain large-scale data systems and pipelines.The ideal candidate will have a strong background in big data technologies such...


  • Mumbai, Maharashtra, India XHire Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to lead our data engineering team. The successful candidate will have expertise in cluster computing technologies, particularly Apache Spark, and experience with cloud technologies such as AWS, Azure, or GCP.About the Role:The ideal candidate will have a...

  • Big Data Analytics Expert

    27 minutes ago


    Mumbai, Maharashtra, India Integrated Personnel Services Limited Full time

    Job OverviewWe are seeking a skilled Big Data Analytics Expert to join our team at Integrated Personnel Services Limited.About the RoleThis is an exciting opportunity for a talented professional to take on a challenging role, working with big data and driving business growth.Key ResponsibilitiesGather requirements and conduct data analysis for multiple...

  • Big Data Strategist

    2 weeks ago


    Mumbai, Maharashtra, India Thema Corporate Services LLP Full time

    Job Summary: Big Data StrategistWe are seeking an experienced Big Data Strategist to join our team at Thema Corporate Services LLP. This role involves developing and implementing strategic plans for Big Data and Cloud Technologies, leveraging AWS, Azure, and GCP.The ideal candidate will have a strong background in Big Data and Cloud Technologies with at...

  • Big Data Specialist

    3 days ago


    Mumbai, Maharashtra, India Cloud Counselage Pvt Ltd Full time

    About the JobAt Cloud Counselage Pvt Ltd, we're seeking a skilled Big Data Specialist to join our team. This exciting opportunity allows you to work with large datasets and uncover valuable insights that drive business growth.We're looking for someone with a solid foundation in data processing technologies like Hadoop, Spark, and Kafka. As a Big Data...


  • Mumbai, Maharashtra, India Recruit Elite Full time

    About the RoleRecruit Elite is seeking an experienced Cloud Native Data Strategist to lead our data strategy efforts. As a key member of our team, you'll be responsible for architecting and working on big data applications and technologies. Our ideal candidate will have at least 8+ years of overall experience with over 3+ years in architecting and working on...


  • Mumbai, Maharashtra, India Sutherland Global Services Full time

    Senior Data Analyst PositionSutherland Global Services offers a competitive salary of $120,000 - $180,000 per year for a Senior Data Analyst. This role requires a strong background in data analysis and experience working with big data, unstructured, and structured datasets.Responsibilities:- Lead and execute end-to-end data projects with big data,...

  • Big Data Engineer

    7 days ago


    Mumbai, Maharashtra, India Tata Consultancy Services Full time

    We are seeking a highly skilled Big Data Engineer to join our team at Tata Consultancy Services. The ideal candidate will have hands-on experience with big data technologies, including Kafka and Scala.Salary: ₹1,500,000 - ₹2,000,000 per annumJob Description:The successful candidate will be responsible for managing GKE workloads and applications, working...


  • Mumbai, Maharashtra, India Infotree Global Solutions Full time

    Job Description:Infotree Global Solutions is seeking an experienced Data Project Manager to lead our big data analytics project. This role involves delivering extensive services and products in the area of big data, including consulting on data storage, integration, preparation, analysis, and use.Key Responsibilities:Maintaining project communication...


  • Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full time

    About the Role:We are seeking a seasoned Senior Technical Hadoop Cloudera Consultant / Architect to spearhead client engagements, craft data strategies, and implement cutting-edge data solutions. This position demands a perfect blend of client consulting, architecture, and hands-on build expertise to drive large-scale Cloudera Data Platform (CDP)...

  • Big Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India Resourcetree Global Services Full time

    **Job Description**We are seeking a Big Data Engineer to join our team at Resourcetree Global Services. As a key member of our big data team, you will be responsible for designing and implementing scalable big data solutions using cloud-based technologies.**Key Responsibilities**Analyze large datasets to generate Business Intelligence (BI) and Advanced...

  • Big Data Expert

    3 weeks ago


    Mumbai, Maharashtra, India Cloud Counselage Pvt Ltd Full time

    About Cloud Counselage Pvt Ltd:A leading technology company, we specialize in big data solutions and strive to provide employment opportunities for millions of job-ready professionals.


  • Mumbai, Maharashtra, India Recruit Elite Full time

    Job Title: Big Data Solutions ArchitectWe are seeking a highly skilled Big Data Solutions Architect to join our team at Freelancer Appudas. As a key member of our data strategy team, you will play a crucial role in designing and implementing scalable big data architectures that drive business growth.Key Responsibilities:* Design and implement big data...

  • Big Data Architect

    2 weeks ago


    Mumbai, Maharashtra, India JMJ CONSULTANTS Full time

    About the PositionJMJ Consultants is looking for a Big Data Architect to join our team. The ideal candidate will have a strong background in data engineering, with experience in designing, developing, and maintaining scalable data pipelines and integrations using PySpark.The successful candidate will be responsible for building and optimizing data systems to...


  • Mumbai, Maharashtra, India Tata Consultancy Services Full time

    About the RoleWe are seeking an experienced Data Scientist to join our team as a Big Data Engineer at Tata Consultancy Services. This role involves designing, developing, and maintaining large-scale data processing systems using big data technologies.