Senior Data Architect

5 hours ago

bangalore, India Tredence Inc. Full time

Designation: Senior Manager (Databricks Architect)


Location: Bengaluru, Chennai, Kolkata, Gurugram, Pune and Hyderabad.


Profile Summary: We are seeking an experienced professional who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data’s full potential.


Roles and Responsibilities:

  • Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
  • Ability to provide solutions that are forward-thinking in data engineering and analytics space
  • Collaboration with DW/BI leads to understanding new ETL pipeline development requirements.
  • Triage issues to find gaps in existing pipelines and fix the issues
  • Work with business to understand the need in reporting layer and develop datamodel to fulfill reporting needs
  • Help joiner team members to resolve issues and technical challenges.
  • Drive technical discussion with client architect and team members
  • Orchestrate the data pipelines in scheduler via Airflow Skills


Qualifications:

  • Bachelor's and/or master’s degree in computer science or equivalent experience.
  • Must have total 12+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
  • Deep understanding of Star and Snowflake dimensional modelling.
  • Strong knowledge of Data Management principles
  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
  • Should have hands-on experience in SQL, Python and Spark (PySpark)
  • Candidate must have experience in AWS/ Azure stack
  • Desirable to have ETL with batch and streaming (Kinesis).
  • Experience in building ETL / data warehouse transformation processes
  • Experience with Apache Kafka for use with streaming data / event-based data
  • Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
  • Experience with Open Source non-relational/ NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
  • Should have experience working in Agile methodology. Job Description:
  • Good Communication and presentations skills.
  • At least 3 years 'experience in Databricks implementations, 2large scale data warehouse end-to-end implementation experience.

  • Data Architect

    5 hours ago

    bangalore, India Tech Mahindra Full time

    Data ArchitectJob Summary:** We are seeking a highly skilled Senior Data Architect with extensive experience in data modeling, Azure Databricks, Azure OpenAI, and associated services. The ideal candidate will be responsible for designing and implementing a scalable, secure, and reliable global data store that supports both batch and near-real-time processing...

  • Senior Data Architect

    24 hours ago

    Bangalore, India Tredence Inc. Full time

    Designation: Senior Manager (Databricks Architect) Location: Bengaluru, Chennai, Kolkata, Gurugram, Pune and Hyderabad . Profile Summary : We are seeking an experienced professional who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and...

  • Senior Data Architect

    24 hours ago

    Bangalore, India Axtria - Ingenious Insights Full time

    Job Title:- Senior Data Architect Location:- NCR/(Bangalore preferably) Experience:- 10+ Years JOB OBJECTIVE: To leverage expertise in data architecture and management to design, implement, and Optimise a robust data warehousing platform for the pharmaceutical industry. The goal is to ensure seamless integration of diverse data sources,...

  • Senior Data Architect

    1 week ago

    Bengaluru / Bangalore, Noida, Pune, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data ArchitectThis is an exciting opportunity to join our organization as a Senior Data Architect. The successful candidate will be responsible for designing, implementing and maintaining large-scale data architectures that support business growth and innovation.Key Responsibilities:Designing and implementing data warehouses, data lakes and...

  • Senior Architect

    24 hours ago

    Bangalore, India Quantiphi Full time

    Company Profile Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are transformative technologies that...

  • Senior Data Architect

    24 hours ago

    Bangalore, India Response Informatics Full time

    We are seeking an experienced Data Architect to lead the transformation of enterprise data solutions, with a strong focus on migrating Alteryx workflows into Azure Databricks. The ideal candidate will have deep expertise in the Microsoft Azure ecosystem, including Azure Data Factory, Databricks, Synapse Analytics, Microsoft Fabric, and a strong ...

  • Senior Data Architect

    6 hours ago

    bangalore, India Response Informatics Full time

    We are seeking an experienced Data Architect to lead the transformation of enterprise datasolutions, with a strong focus on migrating Alteryx workflows into Azure Databricks. Theideal candidate will have deep expertise in the Microsoft Azure ecosystem, including AzureData Factory, Databricks, Synapse Analytics, Microsoft Fabric, and a strongbackground in...

  • Senior Architect

    5 hours ago

    bangalore, India Quantiphi Full time

    Company ProfileQuantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are transformative technologies that will...

  • Senior Data Architect

    24 hours ago

    Bangalore, India Fiserv Full time

    What does a successful Advisor, Data Architect do at Fiserv? As a member of our Data Commerce Solutions group, you will build and take ownership of the design and development of data engineering projects within Fiserv’s Enterprise Data Commerce Solutions division. You will apply your depth of knowledge and expertise to all aspects of the data...

  • Senior Data Architect

    6 hours ago

    bangalore, India Fiserv Full time

    What does a successful Advisor, Data Architect do at Fiserv? As a member of our Data Commerce Solutions group, you will build and take ownership of the design and development of data engineering projects within Fiserv’s Enterprise Data Commerce Solutions division. You will apply your depth of knowledge and expertise to all aspects of the data engineering...