Senior Big Data Architect

16 hours ago

Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 80,00,000 - ₹ 1,20,00,000

Job Opportunity

We are seeking a highly skilled Big Data Specialist with 7 years of experience in IT and 5+ years in Data Engineering to design, build, and maintain data pipelines using Azure Data Factory (ADF), Databricks, and PySpark.

Key Responsibilities:

  • Big Data Pipeline Design and Maintenance: Design, build, and maintain efficient big data pipelines using Azure Data Factory (ADF), Databricks, and PySpark.
  • Large-Scale Dataset Processing: Optimize and transform large-scale datasets using Spark-based processing.
  • Workflow Orchestration: Integrate and orchestrate workflows across Azure services using Logic Apps and ADF pipelines.
  • Efficient SQL Queries: Write efficient SQL queries to handle large datasets and support reporting/analytics needs.
  • Collaboration and Requirements Gathering: Collaborate with data architects, analysts, and business stakeholders to gather requirements and deliver solutions.
  • Data Quality and Compliance: Ensure data quality, consistency, and compliance with data governance policies.
  • Documentation and Knowledge Sharing: Document architecture, pipelines, and ETL/ELT processes for knowledge sharing and maintenance.

Required Skills:

  • Azure Data Engineering Experience: Strong hands-on experience in Azure Data Engineering.
  • Azure Data Factory and Databricks Proficiency: Proficiency in Azure Data Factory (ADF) and Azure Databricks.
  • PySpark Command: Solid command of PySpark for big data processing.
  • Advanced SQL Knowledge: Advanced knowledge of SQL.
  • Agile Development Environment Experience: Experience working in agile development environments.

Desirable Skills:

  • Python Programming: Proficiency in Python for data transformation or automation.
  • Logic Apps Experience: Experience with Logic Apps for workflow integration.

 

  • Senior Big Data Architect

    6 days ago

    Bengaluru, Karnataka, India beBeeDataArchitect Full time ₹ 25,00,000 - ₹ 35,00,000

    Job SummaryWe are seeking a highly skilled Senior Big Data Architect to design and implement large-scale data architectures that drive business growth and innovation. The ideal candidate will have extensive experience in big data technologies, including data warehousing, ETL, and data visualization.Key ResponsibilitiesDesign and implement scalable data...

  • Big Data Solutions Architect

    2 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Big Data EngineerLeverage your expertise in big data processing to drive business growth and innovation.Design and implement scalable big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark.Architect HBase schemas and data models to meet evolving business requirements and ensure optimal performance for data storage...

  • Big Data Architect

    7 days ago

    Bengaluru, Karnataka, India EdgeVerve Full time

    Job Tittle- Big Data ArchitectLocation - Bangalore/ PuneExperience: 10Yrs to 16 YearsExperienced profile with strong integration data architecture, data modeling, database design, proficient in SQL and familiar with at least one cloud platforms. Good understanding of data integration and management tools (MuleSoft/IBM Sterling Integrator/Talend/Informatica.)...

  • Big Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India EdgeVerve Full time

    Job Tittle- Big Data Architect Location - Bangalore/ Pune Experience: 10Yrs to 16 Years Experienced profile with strong integration data architecture, data modeling, database design, proficient in SQL and familiar with at least one cloud platforms. Good understanding of data integration and management tools (MuleSoft/IBM Sterling...

  • Big Data Architect

    2 days ago

    Bengaluru, Karnataka, India EdgeVerve Full time US$ 1,20,000 - US$ 2,00,000 per year

    Job Tittle- Big Data ArchitectLocation - Bangalore/ PuneExperience: 10Yrs to 16 YearsExperienced profile with strong integration data architecture, data modeling, database design, proficient in SQL and familiar with at least one cloud platforms. Good understanding of data integration and management tools (MuleSoft/IBM Sterling Integrator/Talend/Informatica.)...

  • Big Data Architect

    2 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data Architect We are seeking a skilled professional to oversee the collection, storage, and analysis of vast amounts of data. The primary responsibility will be to select and implement optimal solutions for these purposes, maintaining, implementing, and monitoring them. Your duties will include:Selecting and integrating appropriate Big Data...

  • Big Data Solutions Architect

    6 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Role: Big Data Solutions ArchitectThis position is responsible for designing and implementing scalable data pipelines and ETL processes.Main Responsibilities:Architect, optimize big data and analytics solutions using Spark, Delta Lake, and MLflow technologies.Collaborate with stakeholders to translate business requirements into technical solutions that...

  • Big Data Solution Architect

    3 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 40,00,000

    Job Title: Big Data Solution ArchitectAbout the Role:As a Big Data Solution Architect, you will play a key role in designing and implementing scalable data architectures for our clients. You will be responsible for leading teams of engineers and architects to deliver complex data solutions that meet the evolving needs of our clients.Key...

  • Big Data Architect Lead

    5 days ago

    Bengaluru, Karnataka, India beBeeBigData Full time ₹ 1,04,000 - ₹ 1,30,878

    Lead Big Data EngineerYou will be responsible for translating client requirements into design, architecting and implementing big data solutions on Azure Cloud.Provide technical leadership in the areas of data engineering including data ingestion, data access, modeling, data processing, visualization, design and implementation.Lead a team to deliver high...

  • Senior Big Data Specialist

    4 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 12,68,400 - ₹ 25,16,800

    Job Title: About the Role:A Data Engineer is required to join our team in Bangalore, with 3-6 years of experience in big data.Key Responsibilities:Design and develop high-quality data pipelines using Kafka, Flink, and Java.Work closely with cross-functional teams to drive data-driven decision-making.Develop and maintain large-scale distributed systems for...