Senior Big Data Professional

6 days ago

Kannur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Big Data Engineer Job

We are looking for a skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing and executing large-scale distributed data systems.

The ideal candidate should have experience in big data technologies such as Apache Hadoop and relational databases like MS SQL Server or Oracle.

You should also have proficiency in at least one of the following programming languages: Java, Python, or Scala. Additionally, expertise in SQL (T-SQL/PL-SQL/SPARK-SQL/HIVE-QL) is necessary.

Apache Spark experience is a must, with hands-on knowledge of working with Data Frames, Data Sets, RDDs, Spark SQL/PySpark/Scala APIs and deep understanding of performance optimizations.

A good understanding of distributed storage (HDFS/S3) is also required.

Strong analytical/quantitative skills and comfortable working with very large sets of data are essential.

Experience with integration of data across multiple data sources is also a plus.

Key Responsibilities:

  • Designing and executing large-scale distributed data systems
  • Monitoring of performance and optimizing existing projects
  • Researching on and integrating any Big Data tools and frameworks required to provide requested capabilities
  • Understanding Business/Data requirements and implementing scalable solutions
  • Creating reusable components and data tools which help all the teams in the company to integrate with our data platform

What We Are Looking For:

  • 2 to 4 years of experience in big data technologies (Apache Hadoop) and relational databases (MS SQL Server or Oracle)
  • Proficiency in at least one of the following programming languages - Java, Python or Scala
  • Expertise in SQL (T-SQL/PL-SQL/SPARK-SQL/HIVE-QL)
  • Apache Spark experience with hands-on knowledge of working with Data Frames, Data Sets, RDDs, Spark SQL/PySpark/Scala APIs and deep understanding of performance optimizations
  • Good understanding of distributed storage (HDFS/S3)
  • Strong analytical/quantitative skills and comfortable working with very large sets of data
  • Experience with integration of data across multiple data sources

Nice To Have Skills:

  • Experience with Message Queues (e.g., Apache Kafka)
  • Experience with MPP systems (e.g., Redshift/Snowflake)
  • Experience with NoSQL storage (e.g., MongoDB)

  • Big Data Engineer Role

    1 week ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Senior Data Engineer - Big Data and AnalyticsWe are seeking a highly skilled Senior Data Engineer to lead the development of big data and analytics environments on Databricks.Main Responsibilities:Design, build, and maintain complex technical architectures on Databricks, ensuring scalability, reliability, and performance.Develop and implement efficient data...

  • Big Data Expert

    1 week ago

    Kannur, Kerala, India beBeeBigData Full time ₹ 18,00,000 - ₹ 30,00,000

    We're seeking a seasoned Data Scientist to spearhead our Big Data initiatives. As a key member of our team, you will have the opportunity to work with cutting-edge technologies and drive business growth through data-driven insights.About the Role:Design, develop, and implement scalable Big Data solutions using PySpark and Hive.Collaborate with...

  • High-Performance Big Data Professional

    6 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Big Data Developer PositionWe are seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will play a critical role in designing, developing, and maintaining large-scale data processing systems using Big Data technologies.Data Processing System Design: You will design and develop scalable, efficient, and reliable data...

  • Big Data Specialist

    3 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 14,61,120 - ₹ 20,98,960

    Big Data SpecialistWe are seeking a skilled professional to join our team. In this role, you will be responsible for designing and developing scalable data processing systems using big data technologies.Main Responsibilities:Develop software applications using Java, Scala, and other programming languages.Design and implement data pipelines using Apache Spark...

  • Big Data Architect

    2 weeks ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity: Big Data ArchitectThe Senior Data Engineer position involves designing, building, and maintaining large-scale data architectures. This includes data lakes, lakehouses, and warehouses.Key Responsibilities:Create scalable real-time and batch processing workflows using PySpark and Apache Spark.Cleanse, transform, deduplicate, normalize, encode,...

  • Big Data Engineer

    3 weeks ago

    Kannur, Kerala, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Architect

    6 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityLocation: Hyderabad & NoidaWe are seeking a seasoned Data Engineer with 5-8 years of experience to join our team. The ideal candidate will have hands-on experience in Spark, Scala, Big Data (Hadoop), and cloud platforms like AWS/Azure/GCP.Key ResponsibilitiesDesign and develop scalable data processing pipelines using Apache Spark, Kafka, and...

  • Chief Big Data Engineer

    4 days ago

    Kannur, Kerala, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job RoleWe seek a seasoned expert in big data to lead our team. This individual will have extensive experience with pySpark, Hadoop, and Hive.ResponsibilitiesCreate efficient pipelines using cloud-based technologies and adhere to industry best practices.Conduct thorough integration testing and provide estimates for development, deployment, and quality...

  • Big Data Platform Specialist

    2 days ago

    Kannur, Kerala, India beBeeDataiku Full time ₹ 20,00,000 - ₹ 30,00,000

    About People Prime Worldwide:We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.Job Title: Big Data Platform SpecialistLocation: KannurExperience: 7 to 10 YearsEmployment Type: Contract to HireWork Mode: HybridNotice Period: Immediate...

  • Big Data Development Expert

    4 days ago

    Kannur, Kerala, India beBeeDataExpert Full time ₹ 10,00,000 - ₹ 25,00,000

    Big Data Development ExpertKey Highlights:This role is a fantastic opportunity for experienced big data developers to grow and advance their careers.Responsibilities:Analyzing business requirements, crafting technical specifications, and implementing solutions on time.Delivering high-quality results through efficient coding using Spark and Scala.Unit testing...