Senior Big Data Engineer

2 days ago

Kollam, Kerala, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000

Big Data Architectures and Scalable Solutions

  • Drive innovation within the team by designing, architecting, and implementing large-scale data engineering solutions on AWS Cloud Services.
  • Design and develop Big Data architectures leveraging AWS services for complex data processing tasks.
  • Build scalable data pipelines using Spark (Scala) for both structured and unstructured datasets.
  • Architect and operationalize data engineering and analytics platforms on AWS, preferably with Hortonworks or Cloudera experience.
  • Implement and manage various AWS services, including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
  • Work on real-time streaming solutions using Kafka and AWS Kinesis.
  • Support ML model operationalization on AWS, covering deployment, scheduling, and monitoring.
  • Ensure high-quality and reliable data delivery through analyzing source system data and data flows.
  • Write efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.
  • Collaborate with cross-functional teams to provide technical leadership, mentor team members, and strengthen the data engineering capability.
  • Troubleshoot and resolve complex technical issues related to scalability, performance, and security of data solutions.

Required Skills & Qualifications:

  • Mandatory skills: Big Data Technologies (AWS, Scala, Hadoop, and Spark)
  • Proven expertise in Spark with Scala
  • Hands-on experience with AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)

  • Senior Big Data Specialist

    1 day ago

    Kollam, Kerala, India beBeeDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Developer Job DescriptionWe are seeking a skilled and experienced Big Data Developer to join our team. This is a challenging role that requires a strong background in big data technologies.Job Responsibilities:Develop, test, troubleshoot, and deploy big data solutions using Hadoop, Spark, Hive, HDFS, and Kafka.Support ongoing client projects by...

  • Big Data Specialist

    21 hours ago

    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    About This OpportunityWe are seeking a Senior Data Engineer with hands on coding expertise in Python and Pyspark to help implement an application for large retailers.Design, develop, test, deploy, maintain and troubleshoot data pipelines using Python, Pyspark and SQL.Collaborate with business stakeholders to understand requirements and provide technical...

  • Real-Time Data Engineer for Big Query Projects

    2 days ago

    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer - Real-Time Big Query ExpertWe're seeking a seasoned professional to lead the development of robust data pipelines on the Google Cloud Platform.Experience: 10+ yearsWork Location: RemoteShift: Flexible hoursNotice Period: ImmediateThis is an exciting opportunity for a specialist with 10+ years of experience to work on challenging...

  • Big Data Solutions Architect

    4 days ago

    Kollam, Kerala, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Big Data Solutions ArchitectKey Responsibilities include designing and implementing scalable big data solutions, developing efficient ETL processes, leading cross-functional teams in the development of data-driven solutions, and collaborating with stakeholders to design effective data integration strategies.Requirements:5-12 years of experience in...

  • Chief Big Data Architect

    2 days ago

    Kollam, Kerala, India beBeeDataAnalytics Full time ₹ 1,50,00,000 - ₹ 2,25,00,000

    Job SummaryWe are seeking a seasoned professional with extensive experience in big data technologies and Google Cloud Platform services to design and implement scalable data solutions.Key ResponsibilitiesDesign, develop and optimize data pipelines using GCP BigQuery, Dataflow and Apache Airflow to support large-scale data analytics.Utilize the big data...

  • Senior Data Engineering Professional

    2 weeks ago

    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,10,000

    Job Title: Senior Data EngineerWe are seeking an experienced professional to join our organization in the role of Senior Data Engineer. In this position, you will be responsible for developing and implementing data engineering solutions using Python and Pyspark.Key Responsibilities:Design and implement scalable data architectures to support large-scale data...

  • Data Scientist/ML Engineer

    2 weeks ago

    Kollam, Kerala, India Quant-data Full time

    We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team. In this role, you'll design and deploy scalable ML solutions that power loan...

  • Big Data Expert

    1 day ago

    Kollam, Kerala, India beBeeDataiku Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About People Prime Worldwide:We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.Powdered by entrepreneurial professionals, we cater to clients with our domain and technology expertise to drive competitive differentiation, customer...

  • AWS Data Engineer with Advanced Big Data Skills

    2 days ago

    Kollam, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    AWS Data Engineer with Dynamo DB ExpertiseOur organization is seeking a highly skilled and experienced data engineer to contribute to our team. The ideal candidate should have a strong background in AWS services, including Glue, EMR, Lambda, and expertise in data modeling, Python, SQL, PartiQL and integrating third-party APIs from scratch. Key...

  • Big Data Expert

    5 days ago

    Kollam, Kerala, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    We are seeking an experienced data professional to join our team as a Big Data Specialist.The ideal candidate has 6–12 years of experience in handling and processing large datasets, including expertise in Spark technologies such as PySpark/Scala Spark/Java Spark SQL.Key skills include:More than 5.8 years of experience in Big Data projects.A good...