Advanced Big Data Specialist

2 days ago

Cochin, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title: Cloud Data Engineer

">

Are you passionate about building scalable cloud solutions and powering data-driven decision-making?

As a senior-level Cloud Data Engineer, you'll have the opportunity to work on cutting-edge technologies like PySpark, AWS Glue, Lambda, Step Functions, and more.

Key Responsibilities:

  • Build and maintain robust ETL pipelines using PySpark and AWS Glue for efficient data transformation.
  • Collaborate with analysts and stakeholders to ensure high-quality data availability.
  • Write and optimize SQL queries for efficient data processing and storage.
  • Use Git for version control and code collaboration.
  • Design and manage scalable data lakes using AWS S3 and related services for cost-effective and secure data storage.
  • Work with Amazon DynamoDB and Redshift for high-performance data storage and analytics.
  • Develop interactive dashboards using Amazon QuickSight.
  • Automate workflows with AWS Step Functions, Lambda, and EventBridge.
  • Monitor and optimize data workflows for performance and scalability.
  • Troubleshoot complex data issues and resolve them promptly.

Required Skills and Qualifications:

  • Bachelor's in Computer Science, Data Science, or a related field (Master's preferred).
  • Strong hands-on experience with PySpark, Python, and SQL programming languages.
  • Proficient in Git and AWS services (Glue, S3, Lambda, Redshift, Athena, DynamoDB, etc.).
  • Familiarity with Databricks and its ecosystem.
  • Excellent problem-solving and communication skills.
  • Ability to thrive in a fast-paced and collaborative environment.

Preferred Skills:

  • Knowledge of data warehousing and data modeling.
  • Exposure to big data technologies like Hadoop and Spark.
  • AWS certifications in data engineering are a plus.

  • Big Data Expertise

    1 week ago

    Cochin, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Big Data Expertise">We are seeking a skilled professional to lead the design and implementation of large-scale data processing systems.">The ideal candidate will have in-depth knowledge of big data technologies, including data warehousing concepts, data modeling, and agile methodologies.">Key Responsibilities:Design and develop scalable big data...

  • Data Engineer Big Data

    6 days ago

    Cochin, Kerala, India Litmus7 Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Design, develop, and maintain scalable and efficient big data processing pipelines distributed computing systems.Collaborate with cross-functional teams to understand data requirements and design appropriate data solutions.Implement data ingestion, processing, and transformation processes to support various analytical and machine learning use cases.Optimize...

  • Senior Big Data Administrator

    20 hours ago

    Cochin, Kerala, India beBeeDataiku Full time ₹ 10,00,000 - ₹ 23,45,678

    Big Data Administrator Job Description">We are seeking a highly skilled Big Data Administrator to manage our big data platform. This is an exciting opportunity for experienced professionals to work with cutting-edge technology and contribute to the success of our organization.">The ideal candidate will have extensive knowledge of Hadoop, Hive, HBase, and...

  • Advanced Data Analyst

    2 days ago

    Cochin, Kerala, India beBeeDataDriven Full time ₹ 15,00,000 - ₹ 25,00,000

    Job TitleA data-driven analyst is sought to design and implement cutting-edge analytics solutions.The ideal candidate will possess extensive experience in statistical programming and a strong background in working with large data sets and big data tools.The successful candidate will be able to apply their expertise in building world-class analytics...

  • Senior Big Data Hadoop Scala Specialist

    5 days ago

    Cochin, Kerala, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a seasoned professional to lead our big data initiatives. As a Big Data Hadoop Scala expert, you will be responsible for designing and implementing scalable data processing solutions.

  • Big Data Analytics Expert

    5 days ago

    Cochin, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewThe Role of a Big Data DeveloperThis is an exciting opportunity to work with big data, leveraging technologies like Scala, AWS, and Python or Java. ResponsibilitiesAnalyzing large datasets to gain valuable insightsDeveloping and maintaining scalable data processing systemsEnsuring data quality and integrityMust have experience in handling big...

  • Advanced Big Data Specialist

    1 week ago

    Cochin, Kerala, India beBeeData Full time ₹ 10,00,000 - ₹ 12,00,000

    Seeking a skilled Data Engineer for a contract role.Job Title: Data EngineerLocation: RemoteExperience: 5-9 YearsEmployment Type: Contract (6 months renewable)Shift – Australian shiftPositions - 2Key Responsibilities:Develop and maintain large-scale data systems on Google Cloud PlatformDesign and implement efficient data pipelines using Azure...

  • Senior Big Data Solutions Architect

    7 days ago

    Cochin, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a seasoned Senior Big Data Solutions Architect to spearhead the design and implementation of our next-generation data warehouse. This visionary will lead the development of a scalable PostgreSQL-based data warehousing solution, leveraging open-source technologies and cloud infrastructure.Key Responsibilities:Data Engineering &...

  • High-Powered Big Data Specialist

    6 days ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 50,00,000

    Job Title: Data EngineerWe are looking for a skilled Data Engineer to join our team. As a key member of our organization, you will play a vital role in the design, development, and maintenance of our data infrastructure.Responsibilities:Design, build, and deploy scalable data processing systems using big data technologies such as AWS, Python, and...

  • Experienced Big Data Architect

    2 days ago

    Cochin, Kerala, India beBeeCloud Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title: Experienced Big Data ArchitectWe are seeking a highly skilled individual to join our team as a Big Data Architect.Key Responsibilities:Design and develop scalable data engineering solutions leveraging AWS services for large-scale, complex data processing.Build and maintain data pipelines using Spark (Scala) for both structured and unstructured...