Senior Big Data Specialist

23 hours ago

Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Big Data Engineer Opportunity

We are seeking an experienced Big Data Engineer to join our team. As a key member of our data engineering capability, you will play a critical role in designing, developing, and implementing scalable data engineering solutions using AWS services.

Key Responsibilities
  • Design and Develop Big Data Architectures: Utilize AWS services to design and develop big data architectures for large-scale, complex data processing.
  • Build and Maintain Data Pipelines: Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
  • Architect and Operationalize Data Engineering Platforms: Architect and operationalize data engineering and analytics platforms using AWS services and other technologies such as Hortonworks, Cloudera, or MapR.
  • Implement and Manage AWS Services: Implement and manage various AWS services including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
  • Work on Real-Time Streaming Solutions: Work on real-time streaming solutions using Kafka and AWS Kinesis.
  • Support ML Model Operationalization: Support the operationalization of machine learning models on AWS, including deployment, scheduling, and monitoring.
  • Analyze Source System Data: Analyze source system data and data flows to ensure high-quality, reliable data delivery for business needs.
  • Write Efficient SQL Queries: Write highly efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.
  • Collaborate with Cross-Functional Teams: Collaborate with cross-functional teams to provide technical leadership, mentor team members, and strengthen the data engineering capability.
Mandatory Skills & Qualifications
  • Hands-On Experience in Big Data Technologies: Solid hands-on experience in big data technologies, including AWS, Scala, Hadoop, and Spark.
  • Proven Expertise in Spark with Scala: Proven expertise in Spark with Scala.
  • Hands-On Experience with AWS Services: Hands-on experience with various AWS services, including EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, and Lake Formation.

  • Big Data Specialist

    1 week ago

    Bellary, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data SpecialistThis is a key role for a seasoned professional to lead big data projects from start to finish. With 6-12 years of experience, you will be responsible for spearheading big data initiatives and driving business outcomes.Key Responsibilities:Develop innovative big data solutions using PySpark, Hive, Spark, HBase, and DQ tools.Lead agile scrum...

  • Big Data Specialist

    1 week ago

    Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data EngineerJob Summary:We are seeking an experienced and skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies.Key Responsibilities:Design and develop scalable big data...

  • Big Data Strategy Expert

    2 days ago

    Bellary, Karnataka, India beBeeDataSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Big Data SpecialistKey responsibilities for this role include understanding customer data needs and providing tailored solutions, as well as designing and maintaining large-scale data systems.Collaborate with clients to identify their unique requirements and develop effective data strategies.Develop expertise in working with big data technologies such...

  • Big Data Analyst

    4 days ago

    Bellary, Karnataka, India beBeeDataSpecialist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a talented professional to join our team as a Data Specialist.The ideal candidate will have 6-12 years of experience in big data technologies, including Scala Spark and Java Spark SQL. They should also have a good understanding of data structures and algorithms, and have worked on implementation projects building data pipelines, transformation...

  • Senior Big Data Professional

    2 days ago

    Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data ExpertWe are seeking a highly skilled expert to lead our big data projects. The ideal candidate will have expertise in distributed computing principles, Apache Spark, and Python programming.5-12 years of experience in Big Data & Data related technologyExpert-level understanding of distributed computing principlesStrong skills in Apache...

  • Big Data Specialist

    2 days ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Overview:We are seeking a seasoned Data Engineer to spearhead the development of our data infrastructure. As a key member of our team, you will design and implement scalable data pipelines, ensuring seamless data extraction, transformation, and loading.Key Responsibilities:Create and maintain optimal data pipeline architecture for efficient data...

  • Big Data Analytics Specialist

    1 day ago

    Bellary, Karnataka, India beBeeDataScientist Full time ₹ 18,00,000 - ₹ 30,00,000

    Azure Databricks is a cloud-based big data analytics platform.Job SummaryTo be successful in this role, you will develop and maintain scalable data pipelines using Azure Databricks, ensuring seamless integration with existing infrastructure.You will design and implement efficient data architectures to optimize data processing and storage, reducing costs and...

  • Cloud-Based Big Data Specialist

    4 days ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Senior Cloud Data EngineerWe are seeking a seasoned Senior Cloud Data Engineer to join our team. As a key member of our data engineering team, you will play a pivotal role in designing and developing large-scale data processing systems using cloud-based services.You will be responsible for developing and enhancing complex data pipelines using AWS services,...

  • Senior Cloud Data Engineering Specialist

    4 days ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a highly skilled Senior Cloud Data Engineering Specialist to design, implement, and optimize scalable data engineering solutions using Google Cloud Platform (GCP) services.Main Responsibilities:Design and build efficient data pipelines using BigQuery, Dataflow, DataProc, and Cloud Composer to process large-scale data.Leverage...

  • Enterprise Big Data Solutions Architect

    7 days ago

    Bellary, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Big Data Engineer JobGreetings from a leading technology firmWe are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 6 years and maximum of 12 years of experience in big data engineering.Key Responsibilities:Designing, developing, and deploying big data solutions using PySpark and Hive.Working with...