Efficient Data Solutions Specialist

2 days ago

Cochin, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

Senior Data Engineer Position

We are seeking a highly experienced Senior Data Engineer to design and implement high-performance data pipelines, ensuring seamless data flow across systems.

This role involves leveraging expertise in Databricks, Pyspark, and ETL design to build efficient data solutions that meet scalability and security requirements.

The ideal candidate will possess strong skills in ETL pipeline development, optimization, and maintenance, as well as experience with chunking, partitioning, and database tuning.

Additionally, the successful candidate will have excellent communication skills, allowing them to effectively collaborate with cross-functional teams and stakeholders.

  • Key Responsibilities:
  • - Develop, optimize, and maintain scalable ETL pipelines for processing large datasets using Databricks and Pyspark.
  • - Apply advanced techniques such as chunking and partitioning to handle large file volumes efficiently.
  • - Tune and optimize databases for better performance and storage efficiency.
  • - Collaborate with cross-functional teams to ensure the architecture meets business requirements and data quality standards.
  • - Design and implement solutions with an eye toward scalability and long-term performance.
  • - Work with Azure services, including Azure Function Apps, Azure Data Factory, and Cosmos DB.

Required Skills and Qualifications:

  • Technical Skills:
  • - Databricks (advanced-level skills in data engineering workflows)
  • - Pyspark (intermediate-level skills for processing big data)
  • - Strong ETL design skills, particularly in partitioning, chunking, and database tuning for large datasets
  • Soft Skills:
  • - Excellent communication skills for effective collaboration with teams and stakeholders

  • Data Architecture Specialist

    2 days ago

    Cochin, Kerala, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data Architecture SpecialistOverview:We are seeking an experienced Data Architecture Specialist to join our team. This role will involve designing and developing data pipelines using Python, AWS Glue, and EMR.Responsibilities:• Design and develop scalable data pipelines using Python and AWS services.• Write efficient ETL scripts to process...

  • Optimize Production Efficiency

    4 days ago

    Cochin, Kerala, India beBeeOperational Full time US$ 1,02,000 - US$ 1,41,000

    Operational Excellence SpecialistStreamliners Management Consulting is seeking a skilled Operational Excellence Specialist to lead rapid efficiency improvements and drive operational excellence in our clients' operations.This role involves working closely with manufacturers and private equity-owned portfolio companies in North America and Europe to solve...

  • Data Architect Specialist

    4 days ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Architect SpecialistJob Description:Design and oversee the architecture of data solutions, including integration with Power BI, Synapse, Data Factory, and other cloud services.Lead a team in delivering scalable and secure data solutions.Collaborate with stakeholders to gather requirements, translate them into technical designs, and ensure...

  • Data Solutions Expert

    2 hours ago

    Cochin, Kerala, India beBeeData Full time ₹ 60,00,000 - ₹ 70,00,000

    Senior Data Solutions ArchitectWe are seeking an accomplished Senior Data Solutions Architect to spearhead the full lifecycle of our data engineering solutions. As a key member of our team, you will design and develop robust, scalable, and secure data architectures that meet business requirements.About the RoleIn this pivotal position, you will lead the...

  • Data Integration Specialist

    4 days ago

    Cochin, Kerala, India beBeeIntegration Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Global organisations are in need of experts who can unlock the value of their data and drive digital transformation.Job Overview:We're seeking a seasoned integration specialist with expertise in designing, developing and implementing integration solutions using Seeburger BIS.Key Responsibilities:Configure and manage EDI/B2B interfaces with trading partners...

  • Data Solutions Architect

    4 days ago

    Cochin, Kerala, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Solutions ArchitectAbout UsWe are a leading insurance company, with operations in 54 countries and territories. Our mission is to provide commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients.Our VisionWe strive to be at the...

  • Technical Solutions Specialist

    1 day ago

    Cochin, Kerala, India beBeespecialist Full time ₹ 10,00,000 - ₹ 20,00,000

    Job OverviewThe role of a Technical Solutions Specialist involves collaborating with cross-functional teams to design, develop and deploy innovative tools that streamline business processes.Provide expert guidance on tool development and deployment strategies to ensure efficient delivery and adoption.Contribute to the creation of technical documentation and...

  • Databricks Data Solutions Architect

    6 days ago

    Cochin, Kerala, India beBeeDataSolutions Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Title:** Databricks Data Solutions ArchitectDesign, develop and maintain scalable, secure and high-performance data pipelines and ETL processes on Databricks.Lead the architecture and implementation of data solutions that integrate multiple structured and unstructured sources into Delta Lake and cloud data warehouses.Collaborate with business...

  • Chief Data Architecture Specialist

    2 hours ago

    Cochin, Kerala, India beBeeDataArchitecture Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Chief Data Architecture SpecialistAbout the Role:We are seeking a highly skilled Chief Data Architecture Specialist to join our team. As a key member of our organization, you will be responsible for designing and implementing scalable data systems using Power BI, DAX, and advanced SQL.Key Responsibilities:Develop ETL/ELT pipelines and optimize...

  • Business Solutions Specialist

    4 days ago

    Cochin, Kerala, India beBeeProduct Full time ₹ 67,53,328 - ₹ 1,21,85,736

    Business Solutions SpecialistAbout the Role:We seek a skilled Business Solutions Specialist to drive market-driven product development. As a key team member, you will conduct comprehensive market research and gather user feedback to inform strategic decisions.Key Responsibilities:Market Research and Analysis: Conduct thorough market analysis to identify...