Data Engineering Leadership Position

16 hours ago

Alleppey, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Senior Data Engineer Job Description

As a Senior Data Engineer, you will be responsible for designing and implementing data pipelines using AWS services and Apache Airflow. Your primary focus will be on developing scalable and efficient data solutions that meet the needs of our business.

Key Responsibilities:
  • Design and implement data pipelines using AWS services such as S3, EC2, EMR, Lambda, and Step Functions.
  • Develop and maintain spark jobs using Scala for new project needs, enhancing existing ones as required.
  • Optimize spark job performance, conduct stress testing, and implement fixes to ensure high-quality results.
  • Create new data pipelines for developed/enhanced spark jobs using AWS Lambda or Apache Airflow.
  • Design databases, including logical and physical designs, star schema, and snowflake schema to support data warehousing and analytics.
  • Determine optimal data loading strategies based on volume, data types, frequency, and analytics specifications to ensure efficient data processing.
  • Balance cost and performance considerations to ensure the best possible outcome for the business.

The ideal candidate will have 7-9 years of IT experience, with at least 5+ years of experience in AWS-related projects. Associate Level and Professional Level AWS Certification is desirable but not necessary.

Required Skills and Qualifications:

  • Strong knowledge of AWS Services: S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, Step Functions.
  • Cloud Databases: AWS Aurora, Singlestore, RedShift, Snowflake.
  • Big Data: Hadoop, Hive, Spark, YARN.
  • Programming Languages: Scala, Python, Shell Scripts, PySpark.
  • Operating Systems: Any flavor of Linux, Windows.
  • Strong SQL Skills.
  • Orchestration Tools: Apache Airflow.
  • ETL workflow expertise, including complex transformations like SCD, deduplications, aggregations.
Benefits

As a Senior Data Engineer, you will have the opportunity to work on challenging projects and collaborate with a team of experienced professionals. You will also have access to ongoing training and professional development opportunities to help you grow in your career.

In addition to competitive compensation and benefits, we offer a collaborative and dynamic work environment that encourages creativity and innovation. We are committed to diversity and inclusion, and welcome applications from candidates of all backgrounds and experiences.

  • Data Protection Leadership Position

    16 hours ago

    Alleppey, Kerala, India beBeeProtection Full time ₹ 1,50,00,000 - ₹ 1,80,00,000

    Leadership Role - Data Protection and ComplianceOur organization is seeking a seasoned professional to lead the daily operations of Symantec DLP platforms across endpoints, network, and cloud for all global regions.Key Responsibilities: Monitor, triage, and investigate DLP incidents, ensuring timely response and resolution.Policy Management: Manage and...

  • Automotive Technology Leadership Position

    16 hours ago

    Alleppey, Kerala, India beBeeleader Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Program Director OpportunityWe are driving innovation in automotive technology, with a focus on delivering exceptional user experiences. Our mission is to revolutionize the way people interact with their vehicles.The Program Director plays a vital role in overseeing teams of engineers responsible for multiple programs across our product portfolio. The ideal...

  • Reliability Engineering Leadership Position

    22 hours ago

    Alleppey, Kerala, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Reliability Engineering LeaderThe organization seeks a skilled reliability engineering leader to establish and lead the implementation of organizational reliability strategies, aligning service level agreements (SLAs), service level objectives (SLOs), and error budgets with business goals and customer expectations.This role will oversee the...

  • Electrical Engineering Leadership Position

    17 hours ago

    Alleppey, Kerala, India beBeeChipdesign Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Chip Design LeadWe are seeking an accomplished Senior Chip Design Lead to lead the implementation of complex mixed-signal SoCs. As a senior-level chip design expert, you will be responsible for driving the successful execution of our IC design projects.Key Responsibilities:Drive the implementation of complex mixed-signal SoCs, ensuring adherence to...

  • Administrative Leadership Position

    4 days ago

    Alleppey, Kerala, India beBeeAdministrative Full time ₹ 15,00,000 - ₹ 17,50,000

    Dynamic Leadership Role in Higher EducationBecome a key member of our academic and administrative ecosystem as we seek an experienced administrator to strengthen our team.About the Job:We are looking for an individual with a strong educational background, preferably with a Master's degree or Ph.D. in Law, to fill this pivotal role. As Assistant...

  • Entrepreneurial Leadership Position

    1 week ago

    Alleppey, Kerala, India beBeeFoundersOffice Full time ₹ 15,00,000 - ₹ 20,00,000

    Leadership RoleThe core of our organization is driven by the Founder's Office, where strategy and execution converge to deliver measurable outcomes.Key responsibilities include:Strategic planning and vision developmentOperational leadership and partnership managementExecution and outcome-based decision makingAs a key member of this team, you will work...

  • Senior Data Engineer Position

    16 hours ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Responsibilities:In this challenging role, you will be responsible for designing and building high-performance data pipelines that support consulting and analytics solutions. You will collaborate with cross-functional teams to develop and implement data models, ETL processes, and data warehousing solutions.Develop scalable data pipelines to meet business...

  • AI Engineer for Data Analysis

    6 days ago

    Alleppey, Kerala, India beBeeDataScience Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About This RoleWe are seeking a skilled Data Analyst to join our team. As a key member of our data science department, you will play a crucial role in developing analyses and experiments that drive core product metrics.In this position, you will design and run A/B tests and quasi-experiments, convert results into timely product decisions, create...

  • Senior Engineering Manager Position

    6 days ago

    Alleppey, Kerala, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Responsibilities:We are seeking an experienced engineering manager with a proven track record of leadership and technical expertise.Develops and implements product development, testing, and manufacturing processes to drive efficiency and innovation.Leads cross-functional teams in the design and delivery of new products, solutions, and processes.About...

  • Chief Data Executive

    6 days ago

    Alleppey, Kerala, India beBeeDataExecutive Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About Our Leadership OpportunityWe are seeking an experienced professional to assume a leadership position in our Data Management practice, overseeing end-to-end delivery and ensuring the highest standards of excellence.This role encompasses the planning, execution, and governance of Data Engineering, Data Migration, Data Modernization, and Data Governance...