Expert Data Architect

3 days ago

Chennai Bengaluru Gurugram, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 1,80,000

Job Title: Senior Software Engineer II

About the Role

We are seeking a dedicated and skilled developer to join our team of data engineers and data analysts working with various stakeholders.

Responsibilities
  • Data Pipeline Engineering: Design and build scalable, high-performance ETL/ELT pipelines using Azure Data Factory and Azure Databricks, handling ingestion and transformation of data from diverse internal and external sources.
  • Advanced Data Preparation & Transformation: Implement complex transformation logic using PySpark and SQL to standardize, cleanse, and normalize large-scale datasets including nested JSON.
  • Data Modeling: Create and maintain dimensional models (star/snowflake schemas) and structured outputs to support analytics, reporting, and regulatory use cases.
  • Performance Optimization: Profile and tune PySpark jobs for performance using techniques such as caching, partitioning, and broadcast joins. Ensure pipelines scale efficiently with increasing data volumes.
  • Governance & Quality Assurance: Apply robust data validation, quality checks, and maintain metadata lineage with Unity Catalog. Adhere to governance standards across the pipeline lifecycle.
  • Cross-Functional Collaboration: Partner with business analysts, product managers, data scientists, and QA teams to understand data requirements and deliver fit-for-purpose solutions.
  • Documentation & Knowledge Sharing: Maintain comprehensive documentation on data flows, architecture, and models. Support upskilling and mentoring of junior team members.
  • Ai-Enhanced Development: Utilize Databricks Genie and related AI assistants to accelerate development, ensure code quality, and assist in troubleshooting.

Requirements
  • Education: Bachelor s or Master s degree in Computer Science, Data Engineering, or equivalent practical experience.
  • Experience: Total experience of 6 to 8 years and 5+ years in data engineering roles with hands-on experience in PySpark, SQL, and Azure-based data ecosystems.
  • Skills: Strong background in building robust and maintainable pipelines using Azure Data Factory and Databricks, proven expertise in data modeling, schema design, and large-scale data preparation for analytics.
  • Tools: Proficient in Git, version control workflows, and CI/CD practices, solid understanding of data governance, metadata management, and data quality frameworks.
  • Preferred Skills: Exposure to Unity Catalog, Databricks Genie, or other AI-enhanced data engineering tools is preferred, excellent analytical, debugging, and stakeholder communication skills.
  • Bonus Skills: Experience with machine learning workflows and integrating model outputs into data pipelines, exposure to Salesforce, Alfresco, or Schedule A contract data formats is a bonus.

What We Offer:

Our organization provides a dynamic work environment where professionals can grow and thrive.

Successful candidates will have opportunities to develop their technical skills, work with cutting-edge technologies, and collaborate with experienced peers.

Join us and contribute to shaping the future of data engineering

  • Data Architect

    1 hour ago

    Bengaluru, Karnataka, India Vortunix Data Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Lead and mentor a team of data scientists, ML engineers, and research scientists.Drive AI/ML strategy aligned with business goals.Architect scalable ML, NLP, and Generative AI solutions.

  • Ai Data Architect

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 303823 We are currently seeking a AI Data Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Experience: - 10+ years of experience in Solution Architecting of Data & Analytics, AI/ML & Gen AI Solutions as Presales Consultant/ Business Development Manager/ Solution Architect **Responsibilities**: - Solid...

  • Salesforce Technical Architect

    4 hours ago

    Chennai, Tamil Nadu, India NTT DATA Full time US$ 1,50,000 - US$ 2,00,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Salesforce Technical Architect to join our team in Noida\Bengaluru\Chennai\Hyderabad, Karnataka, India. Job Summary: We are seeking...

  • Infrastructure Automation Technical Solutions Architect

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 291793NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Infrastructure Automation Technical Solutions Architect to join our team in Bangalore Karnxc4x81taka IN-KA ...

  • Data Architect

    7 days ago

    Chennai, India TransUnion Full time

    TransUnion's Job Applicant Privacy Notice **What We'll Bring**: - What We'll Bring: Provide guidance, leadership and expertise for SHAPE data architecture, migration strategy and compliance in partnership with the Analytics architecture team. What You'll Bring: This role is for a big data specialist that will design, develop and implement new d features...

  • Data Modelling Architect

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 312265 We are currently seeking a Data Modelling Architect (CoE) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). **Title: Data Modelling Architect (CoE)** **Position Overview**: **Key Responsibilities** - Develop conceptual, logical, and physical data models to support data analytics, streaming and data products...

  • Expert Data Architect

    17 hours ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    About This OpportunityWe are seeking a highly skilled and experienced Senior Consultant/Architect specializing in SAP Datasphere solutions.Key Responsibilities:Design and architect scalable, high-performing, and secure data integration and analytics solutions using SAP Datasphere and associated technologies.Provide technical leadership in integrating SAP...

  • Enterprise Architect

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 328354 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking an Enterprise Architect Solution Executive to join our Client Growth team This role will primarily focus on large...

  • Data & AI Technical Solution Architects

    5 days ago

    Bengaluru, Karnataka, India NTT DATA North America Full time US$ 9,00,000 - US$ 12,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data & AI Technical Solution Architects to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: The  Data &...

  • Data Platform Architect

    7 days ago

    Bengaluru, India growel softech Full time

    Experience in working on Scala, PySpark, Python Experience in working with Airflow, AWS EMR, Google DataProc and Databricks Experience in working with Amazon Redshift and Snowflake Experience in working with Apache Hive, Google BigQuery, Google Data Studio, AWS Athena and Presto. Experience in working with Kafka and Kinesis. Expert knowledge on Data...