Principal Big Data Developer

4 days ago

Dombivli, Maharashtra, India beBeeData Full time ₹ 1,08,00,000 - ₹ 2,02,40,000
Big Data Engineer

We are seeking a skilled Big Data Engineer to join our team.

About the Role:

  • Design, develop and deploy large-scale data processing systems using Python and PySpark.
  • Work with big data technologies such as Hadoop, Spark and NoSQL databases.
  • Collaborate with cross-functional teams to identify business requirements and design data solutions.
  • Maintain and optimize existing data processing pipelines for maximum efficiency.
  • Develop and implement data quality checks and ensure high-quality data is available for analytics and reporting.

Key Requirements:

  • 5+ years of overall IT experience with hands-on experience in big data technologies.
  • Strong proficiency in Python and PySpark with experience building complex data processing applications.
  • Experience working with Amazon EMR, Athena, Glue, Lambda, EC2, S3 and other AWS services.
  • Knowledge of data warehousing concepts, columnar storage formats and compression techniques.
  • Experience working with version control tools like Git.

Benefits:

  • Opportunity to work with cutting-edge technology and be part of a dynamic team.
  • Competitive salary and benefits package.
  • Ongoing training and development opportunities.

Note:

  • Good knowledge of data warehousing concepts – dimensions, facts, schemas- snowflake, star etc.
  • Have worked with columnar storage formats- Parquet,Avro,ORC etc. Well versed with compression techniques – Snappy, Gzip.
  • Good to have knowledge of AWS databases (atleast one) Aurora, RDS, Redshift, ElastiCache, DynamoDB.

  • Big Data Systems Developer

    1 day ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 80,00,000 - ₹ 2,00,00,000

    About the JobWe are seeking a skilled data processing professional to develop and maintain large-scale data systems.Job SummaryThe ideal candidate will have expertise in big data technologies and experience with tools such as PySpark, Hive, Spark, HBase, and DQ tools.Main ResponsibilitiesCreate efficient data processing systems using big data...

  • Big Data Expert

    2 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data ExpertWe are seeking a highly skilled Big Data expert to join our team. As a Big Data expert, you will be responsible for designing and implementing data solutions that meet business needs.Job Description:Design and implement data pipelines using PySpark and Hive.Analyze large datasets to gain insights and inform business decisions.Required...

  • Big Data Specialist

    7 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Key Role: Data Architect SpecialistJob DescriptionThe role is to develop, implement and maintain big data solutions using API procedures, creating stored procedures for advanced analytics and database cleaning functions, and building effective automated data pipelines. The ideal candidate will have experience in managing big data from multiple sources,...

  • Technical Lead for Big Data Solutions

    4 days ago

    Dombivli, Maharashtra, India beBeeTechnicalLead Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Technical Lead for Big Data SolutionsWe are seeking an experienced and strategic Technical Lead to oversee the development of big data solutions using Microsoft Azure, Databricks, and other cloud-native technologies. The ideal candidate will lead a team of talented engineers to design and deliver scalable data pipelines and analytics platforms,...

  • Big Data Developer

    4 days ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering RoleWe are seeking a skilled professional to fill a Data Engineer position. The ideal candidate will have hands-on experience in designing, building, and optimizing scalable data pipelines.This role is responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanced analytics...

  • Giant Data Platforms Software Developer

    7 days ago

    Dombivli, Maharashtra, India beBeeData Full time

    Large-Scale Data Platform Engineer – GCPWe are seeking an experienced Large-Scale Data Platform Engineer to design and build robust data pipelines for ingestion, transformation, and analytics.This is a fantastic opportunity for a talented engineer to work on enterprise-grade data solutions using the best of modern data engineering tools and practices.Key...

  • High-Value Customer Support Specialist

    7 days ago

    Dombivli, Maharashtra, India beBeeTechnical Full time ₹ 13,02,420 - ₹ 16,15,100

    Job Title: Senior Technical Support SpecialistAt the forefront of delivering exceptional technical support, you will be the primary point of contact for high-value and complex customer issues. Your expertise in cloud services, big data platforms, and data governance will enable you to resolve intricate product issues with ease.Key Responsibilities:Act as the...

  • Senior Data Engineer

    4 days ago

    Dombivli, Maharashtra, India LTIMindtree Full time

    Job Title: GCP DeveloperLocation: Pan IndiaExperience 3-16 Years Data projects Good Knowledge of GCP Big query SQL Python dataflow skills Has worked in Implementation projects building data pipelines transformation logics and data models Ability to translate business requirements to technical solutions Collaborate with other teams within the organization...

  • Chief Data Architect

    2 days ago

    Dombivli, Maharashtra, India beBeeData Full time US$ 1,50,000 - US$ 1,70,000

    Job OverviewAs a Lead Data Engineer, you will be responsible for leading a team of data engineers. You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs.You will also provide technical leadership and guidance to your team, ensuring they have the necessary skills and knowledge to...

  • Principal Storage Automation Software Developer Engineer

    2 days ago

    Dombivli, Maharashtra, India beBeeExpert Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Overview of the Role:As a Principal SDET, you will be responsible for leading software development and testing efforts in our organization.We are seeking an experienced professional with a strong background in storage/backup/virtualization domain to join our team.The ideal candidate will have a minimum of 5+ years of experience in testing, with expertise in...