Senior Big Data Specialist

2 weeks ago

Gurgaon Gurugram Chennai Bengaluru Bangalore, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

**Job Opportunity:** Data Engineer

Key responsibilities include:

  • Collaborate closely with Product Owners and AWS Professional Service Architects to comprehend requirements, formulate solutions, and implement them.
  • Design and implement scalable data transformation pipelines as per the defined design - Develop Data model and Data Architecture in line with the outlined design.
  • Evaluate new capabilities of AWS analytics services, develop prototypes, and assist in drawing POVs, participate in design discussions

Requirements:

  • A minimum of 3 years of experience implementing transformation and loading of data from a wide variety of traditional and non-traditional sources such as structured, unstructured, and semi-structured using SQL, NoSQL, and data pipelines for real-time, streaming, batch, and on-demand workloads
  • At least 2 years of experience implementing solutions using AWS services such as Lambda, AWS Athena, and Glue, AWS S3, Redshift, Kinesis, Lambda, Apache Spark,
  • Experience working with data warehousing, data lakes, or Lakehouse concepts on AWS
  • Experience implementing batch processing using AWS Glue/Lake formation, & Data Pipeline
  • Experience in EMR/MSK
  • Experience or Exposure to AWS Dynamo DB will be a plus
  • Develop object-oriented code using Python, besides PySpark, SQL, and one other language (Java or Scala would be preferred)
  • Experience on Streaming technologies both On-Prem/Cloud such as consuming and producing from Kafka, Kinesis
  • Experience building pipelines and orchestration of workflows in an enterprise environment using Apache Airflow/Control M
  • Experience implementing Redshift on AWS or any one of Databricks on AWS, or Snowflake on AWS
  • Good understanding of Dimensional Data Modelling will be a plus.
  • Ability to multi-task and prioritize deadlines as needed to deliver results
  • Ability to work independently or as part of a team
  • Excellent verbal and written communication skills with great attention to detail and accuracy
  • Experience working in an Agile/Scrum environment

  • Big Data Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Big Data SpecialistExperience:2+ years of experience in big data development.The ideal candidate will have expertise in:Big Data DevelopmentAdvanced AnalyticsCloud ComputingProgramming Skills (Python, Java)As a big data specialist, you will be responsible for designing and developing large-scale data processing systems. Your focus will be on...

  • Senior Big Data Professional

    1 week ago

    Chennai, Tamil Nadu, India beBeeHadoop Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data SpecialistHiring for a Big Data specialist with expertise in Hadoop and its ecosystem. The ideal candidate will have hands-on experience with Hadoop, Hive, SQL, Spark, and other Big Data tools.ResponsibilitiesDelivering code and setting up the environmentEnsuring connectivity and deploying the code in production after testingWorking closely with the...

  • Senior Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataScience Full time ₹ 18,00,000 - ₹ 25,00,000

    Big Data SpecialistThe ideal candidate will have 4+ years of hands-on experience in big data development, utilizing programming languages such as Java and Scala.Develop and maintain scalable big data applications using various technologies.Collaborate with cross-functional teams to design and implement robust big data solutions.Stay up-to-date with emerging...

  • Senior Big Data Python Developer

    2 days ago

    Chennai, India Innovatz Global Full time

    Company Description Innovatz is a Global Management Consulting, Technology Services, and Business Process Outsourcing Company headquartered in Kuala Lumpur, Malaysia. With a strong presence in America, China, India, Australia, Korea, Hong Kong, and various other countries, Innovatz has a skilled workforce of over 500, including Subject Matter Experts,...

  • Senior Big Data Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Job Title: Senior Big Data SpecialistWe are looking for a highly skilled individual to lead the development and maintenance of our data processing systems. The ideal candidate will have extensive experience in designing, building, and optimizing large-scale data architectures using Apache Spark and related technologies.Main Responsibilities:Design and...

  • Big Data Architect

    7 days ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 18,00,000 - ₹ 28,00,000

    Senior Big Data SpecialistWe are seeking a highly skilled Senior Big Data Specialist to join our organization in Bengaluru, India. The successful candidate will be responsible for designing and implementing large-scale data systems using Apache Spark, Python, and Azure Databricks.The ideal candidate will have 5-12 years of experience in Big Data & Data...

  • Senior Cloud Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeCloud Full time ₹ 9,00,000 - ₹ 12,00,000

    **Job Title:** Senior Cloud Engineer - Big Data Specialist**Job Description:** We are seeking an experienced Senior Cloud Engineer to join our team. As a cloud expert, you will be responsible for designing and implementing scalable big data solutions using Google Cloud Platform (GCP).We need a candidate with extensive production experience in GCP and a...

  • Big Data Cloud Architect Specialist

    2 weeks ago

    Bengaluru / Bangalore, Gurgaon / Gurugram, India beBeeDatabricks Full time ₹ 15,000 - ₹ 28,00,000

    Job Title:Azure Databricks Platform ExpertAbout the Role:The Impact you will have :Platform Administration: Manage day-to-day administration tasks such as configuring clusters, monitoring platform health, troubleshooting issues, and performing routine maintenance and upgrades.Evaluate new features and enhancements introduced by Azure Databricks from a...

  • Big Data Analytics Specialist

    1 week ago

    Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,50,000 - ₹ 28,00,000

    Job Title: Big Data Analytics Specialist\Hadoop Spark and Hive are at the core of our big data strategy. As a Big Data Analytics Specialist, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Spark technologies.\Key Responsibilities:\\Design and develop ETL processes using Hadoop and Spark...

  • Big Data Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data SpecialistWe are seeking a highly skilled professional to develop and maintain large-scale data systems.Key Responsibilities:Design, implement, and deploy data processing pipelines.Develop and maintain ETL processes for big data technologies.Collaborate with cross-functional teams to ensure data quality and integrity.Ensure data security and...