Data Scientist and Big Data Expert

1 day ago

Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000
Big Data Engineer Role

We are seeking a skilled professional with expertise in designing, architecting, and implementing data engineering solutions. The ideal candidate will bring hands-on experience in Big Data technologies and AWS Cloud Services.

Key Responsibilities:

  • Data Engineering: Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex data processing.
  • Data Pipelines: Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
  • Platform Architecture: Architect and operationalize data engineering and analytics platforms (AWS preferred; Hortonworks, Cloudera, or MapR experience a plus).
  • AWS Services: Implement and manage AWS services including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
  • Real-Time Streaming: Work on real-time streaming solutions using Kafka and AWS Kinesis.
  • ML Model Deployment: Support ML model operationalization on AWS (deployment, scheduling, and monitoring).
  • Data Analysis: Analyze source system data and data flows to ensure high-quality, reliable data delivery for business needs.
  • SQL Queries: Write highly efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.
  • Cross-Functional Teamwork: Collaborate with cross-functional teams to provide technical leadership, mentor team members, and strengthen the data engineering capability.
  • Troubleshooting: Troubleshoot and resolve complex technical issues, ensuring scalability, performance, and security of data solutions.

Mandatory Skills & Qualifications:

  • Hands-On Experience: Solid hands-on experience in Big Data Technologies (AWS, Scala, Hadoop and Spark Mandatory)
  • Proven Expertise: Proven expertise in Spark with Scala
  • Experience with AWS Services: Hands-on experience with: AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)

  • Data Scientist

    3 days ago

    Aurangabad, Maharashtra, India GLOWSTAR Full time

    Company Description GlowStar Diamond, a leading diamond manufacturer based in India, has been importing and exporting cut and polished diamonds since 1995. Each GlowStar Diamond is crafted using traditional techniques in India, ensuring superior cut, sparkle, and beauty. GlowStar operates in major diamond centers such as India, Belgium, Hong Kong, and the...

  • Data Scientist

    4 weeks ago

    Aurangabad, Maharashtra, India EXL Full time

    We are seeking a skilled Data Scientist with experience in Python, AI/ML to design, develop, and deploy cutting-edge machine learning solutions. You will work closely with data scientists, analysts, and engineering teams to translate business needs into scalable AI-driven applications.Key Responsibilities:Design, implement, and optimize machine learning...

  • Data Scientist Developer

    6 days ago

    Aurangabad, Maharashtra, India beBeeMachineLearning Full time ₹ 12,00,000 - ₹ 18,00,000

    Job Title:Data Scientist DeveloperJob DescriptionThis is a full-time on-site role for a data scientist developer, located in Hyderabad. The successful candidate will be responsible for developing machine learning models, creating and optimizing algorithms, and applying pattern recognition techniques to drive business growth.Create and optimize machine...

  • Data Scientist

    4 days ago

    Aurangabad, Maharashtra, India Celebal Technologies Full time

    Job Role: Lead Data ScientistJob Location: JaipurJob Type: PermanentExperience Required: 5+ yearsJob Summary:We are looking for an experienced Lead Data Scientist to head our AI and Machine Learning initiatives. This role is perfect for a professional who can drive innovation in Classical Machine Learning, Conversational AI, and Deep Learning Systems while...

  • Big Data Developer

    1 week ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Financial Data EngineerWe are seeking a highly skilled data professional to join our team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data, including stocks, cryptocurrencies, and third-party data sources.Main Responsibilities:Design, develop, and manage end-to-end...

  • Data Scientist Specialist

    1 week ago

    Aurangabad, Maharashtra, India beBeeEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    About the RoleWe are seeking a skilled professional to fill the position of Data Engineer.This role involves building scalable pipelines, working with streaming data, and collaborating with data scientists and stakeholders to deliver high-quality solutions.Key ResponsibilitiesDesign and build data pipelines and ETL workflows using Spark, PySpark, and...

  • Big Data Strategist

    1 week ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    As a leading Big Data Specialist, you will spearhead our data analytics initiatives. Your expertise in leveraging big data technologies such as PySpark and Hive to drive business growth will be instrumental in propelling our company forward.Key Responsibilities:Develop and implement scalable data architectures using Spark, HBase, and DQ tools to enhance data...

  • Enterprise Data Engineer

    2 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 19,80,000 - ₹ 21,90,000

    Job Title: Enterprise Data EngineerKey Highlights:Data Platform Architect: Design and develop scalable data pipelines using cloud-based platforms like AWS Glue, Airflow, and Snowflake.Cloud and Big Data Expertise: Develop robust architectures for data platforms on AWS (Redshift, Lambda, S3, Athena) and leverage Spark, Kafka, Hive for processing.Data...

  • **Data Transformation Expert**

    1 week ago

    Aurangabad, Maharashtra, India beBeeBigData Full time ₹ 2,20,00,000 - ₹ 2,60,00,000

    Technical Leadership RoleAt the forefront of our organization lies a groundbreaking opportunity for a visionary Technical Lead to spearhead the development of our cutting-edge big data platform. This pivotal position demands strategic thinking, technical acumen, and exceptional leadership qualities.Reporting directly to an Engineering Manager, you will be...

  • Senior Big Data Specialist

    1 day ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 21,74,000 - ₹ 26,10,000

    Job Opportunity: Big Data Developer">The company we work with is a leading provider of software services. They have helped numerous businesses meet their IT requirements by utilizing the latest technologies, offering flexible engagement models and rapidly deployable solutions.We are seeking a skilled Big Data Developer to join our team. The ideal candidate...