Big Data Specialist

1 week ago


Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Senior Big Data Engineer

Job Summary:

We are seeking an experienced and skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies.

Key Responsibilities:

  • Design and develop scalable big data architectures using Apache Spark, Hadoop, and related technologies.
  • Develop high-performance data processing applications using Python, PySpark, and related frameworks.
  • Work closely with cross-functional teams to identify business requirements and develop solutions that meet those needs.
  • Collaborate with data scientists to integrate machine learning models into our big data pipelines.

Requirements:

  • 5+ years of experience in big data technologies, including Apache Spark, Hadoop, and related tools.
  • Strong proficiency in Python programming language and experience with PySpark.
  • Experience with cloud-based big data platforms such as Amazon EMR, Amazon Athena, and AWS Glue.
  • Knowledge of data warehousing concepts, including dimensions, facts, schemas, and star/snowflake designs.
  • Experience with columnar storage formats, such as Parquet, Avro, and ORC, as well as compression techniques like Snappy and Gzip.

Preferred Qualifications:

  • Experience with AWS databases, including Aurora, RDS, Redshift, ElastiCache, and DynamoDB.
  • Knowledge of data streaming technologies, such as Apache Kafka and Apache Flink.
  • Experience with containerization using Docker and orchestration using Kubernetes.

What We Offer:

  • A competitive salary and benefits package.
  • The opportunity to work with a talented team of engineers and data scientists.
  • The chance to contribute to the development of cutting-edge big data technologies.

  • Big Data Specialist

    6 days ago


    Bellary, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data SpecialistThis is a key role for a seasoned professional to lead big data projects from start to finish. With 6-12 years of experience, you will be responsible for spearheading big data initiatives and driving business outcomes.Key Responsibilities:Develop innovative big data solutions using PySpark, Hive, Spark, HBase, and DQ tools.Lead agile scrum...

  • Big Data Analyst

    2 days ago


    Bellary, Karnataka, India beBeeDataSpecialist Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a talented professional to join our team as a Data Specialist.The ideal candidate will have 6-12 years of experience in big data technologies, including Scala Spark and Java Spark SQL. They should also have a good understanding of data structures and algorithms, and have worked on implementation projects building data pipelines, transformation...

  • Big Data Specialist

    8 hours ago


    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Overview:We are seeking a seasoned Data Engineer to spearhead the development of our data infrastructure. As a key member of our team, you will design and implement scalable data pipelines, ensuring seamless data extraction, transformation, and loading.Key Responsibilities:Create and maintain optimal data pipeline architecture for efficient data...


  • Bellary, Karnataka, India beBeeDataSpecialist Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Big Data SpecialistKey responsibilities for this role include understanding customer data needs and providing tailored solutions, as well as designing and maintaining large-scale data systems.Collaborate with clients to identify their unique requirements and develop effective data strategies.Develop expertise in working with big data technologies such...


  • Bellary, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data ExpertWe are seeking a highly skilled expert to lead our big data projects. The ideal candidate will have expertise in distributed computing principles, Apache Spark, and Python programming.5-12 years of experience in Big Data & Data related technologyExpert-level understanding of distributed computing principlesStrong skills in Apache...


  • Bellary, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Big Data Engineer JobGreetings from a leading technology firmWe are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 6 years and maximum of 12 years of experience in big data engineering.Key Responsibilities:Designing, developing, and deploying big data solutions using PySpark and Hive.Working with...


  • Bellary, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Architect PositionJob Description:We are seeking a skilled Cloud Data Architect to join our team. As a key member of our Digital & Data Solutions (DDS) group, you will be responsible for designing and implementing Big Data architectures and cloud adoption strategies.This is a full-time hybrid role that offers flexibility for remote work. The ideal...


  • Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Technical LeadWe are seeking an experienced technical lead to join our team. As a technical lead, you will be responsible for building a scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports to an engineering manager and requires...


  • Bellary, Karnataka, India beBeeInformatica Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Data Integration SpecialistWe are seeking a skilled data integration specialist to join our team. The ideal candidate will have expertise in designing, developing, and testing ETL architectures for large-scale data systems.Design and develop scalable ETL workflows using Informatica BDM/DEI.Integrate data from structured and unstructured sources,...


  • Bellary, Karnataka, India beBeeHadoop Full time ₹ 1,80,00,000 - ₹ 2,70,00,000

    Job DescriptionSeeking a talented individual to lead Big Data initiatives, utilizing expertise in Scala and Hadoop ecosystem tools.Proficient in SQL and able to optimize queries for improved performance.Required Skills and QualificationsTechnical Requirements:Hands-on experience with Scala, Spark, Hive, and Hadoop Big Data Eco System Tools.Strong SQL skills...