Senior Cloud Data Engineer Position

6 hours ago

Hubli, Karnataka, India beBeeCloudEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Senior Cloud Data Engineer

Key Result Areas and Activities:

  • Study existing technology landscape and understand current data integration framework and do impact assessment for the requirements.
  • Develop scalable big data solutions using Spark for new project requirements.
  • Enhance existing Spark applications for any ongoing product enhancement.
  • Performance tuning of Spark jobs, stress testing etc.
  • Create new data pipelines for developed/enhanced Spark jobs using AWS Lambda or Apache Airflow
  • Responsible for database design process, logical design, physical design, star schema, snowflake schema etc.
  • Analyze data processing, integration, modelling and reporting requirements & Define data loading strategies considering volume, data types, frequency and analytics specifications.
  • Ensure optimal balance between cost and performance.
  • Project documentation, Adheres to Quality guidelines & Schedules.
  • Works hand in hand with PM for successful delivery of project and provide Estimation, scoping, scheduling assistance.
  • Manage build phase and quality assure code to ensure fulfilling requirements and adhering to Cloud architecture. Resolve difficult design and develop issues.

Work and Technical Experience:

Must-Have:

  • Overall, 7-9 years of IT Experience
  • 5+ years of AWS related projects
  • Good to have Associate Level and Professional Level AWS Certification
  • In depth knowledge of following AWS Services required: S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, Step Functions
  • Cloud Databases (Must have) - AWS Aurora, Singlestore, RedShift, Snowflake
  • Big Data (Must have) - Hadoop, Hive, Spark, YARN
  • Programming Language (Must have) - Scala, Python, Shell Scripts, PySpark
  • Operating System (Must have) - Any flavor of Linux, Windows
  • Must have very strong SQL Skills
  • Orchestration Tools (Must have): Apache Airflow
  • Expertise in developing ETL workflows comprising complex transformations like SCD, deduplications, aggregations etc.
  • Should have thorough conceptual understanding of AWS VPC, Subnets, Security Groups, & Route Tables
  • Should be a quick and self-learner and be ready to adapt to new AWS Services or new Big Data Technologies as and when required

Qualifications:

  • Bachelor's degree in computer science, engineering, or related field (Master's degree is a plus)
  • Demonstrated continued learning through one or more technical certifications or related methods
  • Minimum 5 years of experience on Cloud related projects

Personal Qualities:

  • Hold strong technical knowledge and experience
  • Should have the capability to deep dive and research in various technical related fields
  • Self-motivated and focused on delivering outcomes for a fast-growing team
  • Able to communicate persuasively through speaking, writing, and client presentations
  • Able to work in a self-organized and cross-functional team
  • Prior experience of working in a large media company would be an added advantage

  • Senior Cloud Data Specialist

    5 days ago

    Hubli, Karnataka, India beBeeDatabase Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Redshift Database AdministratorOverviewThis is a senior-level position responsible for overseeing and maintaining scalable cloud environments and data-driven applications.Administer and maintain cloud environments and data applicationsInstall, configure, and update software, services, and applicationsManage and maintain databases using AWS...

  • Cloud Data Architect Position

    6 hours ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,44,00,000 - ₹ 2,15,60,000

    Cloud Data Expert Wanted">Total years of experience: 12+ Years">Relevant experience for engagement: 10 Years">We are looking for a skilled Cloud Data Expert to design and implement solution in the following areas:">">Data Warehousing">Maintain architecture principles, guidelines and standards">Programming Language: Python/Java">Big Data">Data...

  • Senior Cloud Data Professional

    4 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior AWS Data EngineerWe are seeking a seasoned data engineer to join our team in designing, developing, and deploying end-to-end data pipelines on AWS cloud infrastructure.The ideal candidate will have hands-on experience with Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, and Apache Spark.Responsibilities:Design and implement data...

  • Cloud Data Engineer

    48 minutes ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Cloud Data EngineerKey ResponsibilitiesDesign, develop and maintain large-scale data processing systems on cloud platforms.Develop and implement data pipelines using cloud services such as BigQuery, Dataflow and Cloud Composer.Collaborate with cross-functional teams to integrate data solutions with business requirements.Ensure high-quality data...

  • Cloud Data Engineer

    4 days ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Data Engineering RoleWe are seeking a highly skilled professional with expertise in Apache Ray to fill this key position.Key Responsibilities:Operate, monitor, and troubleshoot all aspects of production and non-production environments using Apache Ray.Automate deployment and orchestration of services into cloud environments such as AWS and GCP.Ensure...

  • Senior Cloud Data Solutions Engineer

    7 hours ago

    Hubli, Karnataka, India beBeeData Full time US$ 12,00,000 - US$ 20,00,000

    Cloud Data ArchitectWe are a boutique AI and data engineering firm that empowers Fortune 1000 companies through AI-powered decision intelligence—especially in finance and supply chain transformation—delivering financial benefits while fostering a highly developed people-first culture.Key Responsibilities:You will act as a key member of the consulting...

  • Senior Data Engineer

    6 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,20,00,000

    As a senior data engineer, you will be responsible for designing and implementing scalable, secure, and efficient solutions on the Databricks platform.The ideal candidate will have experience working with Databricks, including platform architecture, data engineering, and data analytics. Proficiency in languages such as Python, Scala, or Java is also...

  • Cloud Data Engineer

    51 seconds ago

    Hubli, Karnataka, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title:Data Integration SpecialistJob Description:In a fast-paced and innovative work environment, we seek an experienced Data Integration Specialist to collaborate with our team in developing robust data pipelines for processing channel activity data from multiple sources. This role requires strong expertise in AWS cloud infrastructure, big data...

  • Senior Data Solutions Engineer

    9 hours ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 13,49,000 - ₹ 21,13,300

    Data Engineering PositionSeeking an accomplished data professional with 4+ years of experience in Azure technologies and proficiency in Python, Scala, Spark, and Azure Cloud services.As a key member of our team, you will be responsible for designing and developing scalable ETL pipelines using Azure Data Factory, Databricks, and Spark. You will implement...

  • Cloud Data Architect Position Available

    6 hours ago

    Hubli, Karnataka, India beBeeGcpSkills Full time ₹ 15,00,000 - ₹ 30,00,000

    Data Engineer OpportunityWe are seeking an experienced Data Engineer to join our team. This is a unique chance for professionals with 6–12 years of experience in cloud technologies.This role is ideal for those who have worked on implementation projects building data pipelines, transformation logic, and data models.We are looking for someone with good...