Data Platform Architect

2 days ago

Bikaner, Rajasthan, India beBeeDatabricks Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
ETL Developer in Databricks PySpark

We are seeking a skilled ETL developer to join our team and contribute to the design, development, and maintenance of efficient data pipelines using Databricks PySpark.

The successful candidate will have experience in designing and developing ETL processes, optimizing workflows for performance and scalability, and implementing robust error handling and monitoring mechanisms.

Key Responsibilities:

  • Design and develop ETL processes using Databricks PySpark to extract, transform, and load data from various sources into a data lake and data warehouse.
  • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
  • Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
  • Design and implement data solutions following best practices for data governance and quality principles.
  • Ensure data is appropriately cleansed, enriched, and optimized at each stage to support robust analytics and reporting.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Minimum of 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.
  • Proficiency in Python programming, with extensive experience in developing and debugging Databricks PySpark applications.
  • In-depth understanding of Spark architecture and internals, with hands-on experience in Spark RDDs, DataFrames, and Spark SQL.
  • Expertise in writing and optimizing complex SQL queries for data manipulation, aggregation, and analysis.
  • Proven experience in working with large-scale data warehousing and ETL frameworks.
  • Strong problem-solving skills and the ability to troubleshoot and resolve ETL process issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

Preferred Qualifications:

  • Experience with cloud platforms with a preference for AWS.
  • Experience with data platform tools such as DataBricks, Snowflake, and Tableau.
  • Demonstrated ability to implement best practices for ETL processes and data management.
  • Strong understanding of data governance and data quality principles.
  • Relevant certifications in Databricks PySpark, Spark SQL, or related technologies.

  • Chief Data Architect

    2 days ago

    Bikaner, Rajasthan, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Data Platform ArchitectOur modern data platform is a highly scalable, efficient and secure system designed to meet the demands of our fast-paced business.About the Role:We are seeking an experienced Data Platform Architect to lead the design and implementation of our data infrastructure.The ideal candidate will have expertise in designing and implementing...

  • Cloud Data Platform Specialist

    3 days ago

    Bikaner, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe're seeking a skilled Cloud Data Engineer to join our team and drive the growth of our advanced analytics practice. This is an exciting opportunity to build and scale our cloud data platform, making it more scalable, reliable, and cost-efficient.The ideal candidate will have experience with Databricks, including Spark SQL and Delta Lake...

  • Senior Financial Data Architect

    18 hours ago

    Bikaner, Rajasthan, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleWe are seeking a highly skilled Data Architect to join our team.This role involves designing, building, and maintaining robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and develop end-to-end data pipelines for stocks, crypto, and other financial datasets.Integrate third-party APIs and data feeds into internal...

  • Advanced Data Architect

    2 days ago

    Bikaner, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Integration Systems ArchitectWe are seeking a skilled Integration Systems Architect to design and implement data integration solutions.Key Responsibilities:Design, build, and deploy ETL processes to extract, transform, and load customer data into data warehouses.Develop SQL scripts to optimize data processing and analytics performance.Work with solution...

  • Data Architect Lead

    4 days ago

    Bikaner, Rajasthan, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key Role: Data ArchitectThis key position requires a detail-obsessed data architect to design and implement scalable, semantic-layered datasets with historical tracking and versioning.The ideal candidate will have advanced Python skills for API extraction, automation, and orchestration, as well as expertise in GA4 implementation and data...

  • Chief Data Architect

    2 days ago

    Bikaner, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data ArchitectWe are seeking a seasoned professional to lead our data architecture strategy. This is an exceptional opportunity for a visionary leader who can drive business growth through innovative data solutions.Key Responsibilities:Data Architecture: Design and implement scalable, secure enterprise data architectures.Data Pipelines: Develop,...

  • Strategic Data Architect

    4 days ago

    Bikaner, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Technical Lead - Big DataWe seek a highly experienced Technical Manager with deep expertise in big data platforms, Azure, and Databricks.About the Role:The ideal candidate will lead a team of talented data engineers to design and deliver scalable data pipelines and analytics platforms ensuring high performance, reliability, and security in a cloud-native...

  • Cloud Data Architect

    3 days ago

    Bikaner, Rajasthan, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 1,40,000

    Data Engineering Role OverviewAs a seasoned Cloud Data Architect, you will be working with our team to guide and assist clients' data modernization journey. You'll be the day-to-day primary point of contact with our clients to modernize their data infrastructures, architecture, and pipelines.Consulting clients on cloud-first strategies for core data...

  • Data Cloud Architect Leader

    1 hour ago

    Bikaner, Rajasthan, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job SummaryThis role is a key opportunity to drive strategic leadership and technical expertise in Salesforce Data Cloud. As a seasoned professional, you will spearhead our data initiatives with 10+ years of hands-on experience.The ideal candidate will design scalable architectures, enable enterprise-wide data-driven transformations, and unlock customer...

  • Chief Data Architect

    1 day ago

    Bikaner, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team and lead the design, build, and maintenance of our data pipeline architecture.The ideal candidate will have extensive experience in constructing and optimizing complex data pipelines, collaborating closely with data scientists and analysts to facilitate data-related...