Delta Lake Architect

5 months ago

Bengaluru Karnataka, India Thoucentric Full time

**About us**:
**Thoucentric is the Consulting arm of Xoriant**, a prominent digital engineering services company with 5000+ employees. We are headquartered in Bangalore with presence across multiple locations in India, US, UK, Singapore & Australia Globally.

As the Consulting business of **Xoriant**, We help clients with Business Consulting, Program & Project Management, Digital Transformation, Product Management, Process & Technology Solutioning and Execution including Analytics & Emerging Tech areas cutting across functional areas such as Supply Chain, Finance & HR, Sales & Distribution across US, UK, Singapore and Australia. Our unique consulting framework allows us to focus on execution rather than pure advisory. We are working closely with marquee names in the global consumer & packaged goods (CPG) industry, new age tech and start-up ecosystem. Xoriant (Parent entity) started in 1990 and is a Sunnyvale, CA headquartered digital engineering firm with offices in the USA, Europe, and Asia. Xoriant is backed by ChrysCapital, a leading private equity firm. Our strengths are now combined with Xoriant’s capabilities in AI & Data, cloud, security and operations services proven for 30 years.

We have been certified as "**Great Place to Work"** by AIM and have been ranked as "50 Best Firms for Data Scientists to Work For".

We have an experienced consulting team of over 450+ world-class business and technology consultants based across six global locations, supporting clients through their expert insights, entrepreneurial approach and focus on delivery excellence. We have also built point solutions and products through Thoucentric labs using AI/ML in the supply chain space.

As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and collaborative environment, leveraging your expertise in Hive, Hadoop, and PySpark to unlock valuable insights from our data.

**Key Responsibilities**:
**Data Ingestion and Integration**:

- Develop and maintain data ingestion processes to collect data from various sources.
- Integrate data from different platforms and databases into a unified data lake.

**Data Processing**:

- Create data processing jobs using Hive and PySpark for large-scale data transformation.
- Optimize data processing workflows to ensure efficiency and performance.

**Data Pipeline Development**:

- Design and implement ETL pipelines to move data from raw to processed formats.
- Monitor and troubleshoot data pipelines, ensuring data quality and reliability.

**Data Modeling and Optimization**:

- Develop data models for efficient querying and reporting using Hive.
- Implement performance tuning and optimization strategies for Hadoop and Spark.

**Data Governance**:

- Implement data security and access controls to protect sensitive information.
- Ensure compliance with data governance policies and best practices.

**Collaboration**:

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide data support.

**Requirements**:
**Qualifications**:
- Bachelor’s degree in computer science, Information Technology, or a related field.
- 8+ years of experience in big data engineering and data processing.
- Proficiency in Hive, Hadoop, Airflow and PySpark.4
- Strong SQL and NoSQL database experience.
- Experience with data warehousing and data modeling.
- Knowledge of data integration, ETL processes, and data quality.
- Strong problem-solving and troubleshooting skills.

**Preferred Qualifications**:

- Experience with cloud-based big data technologies (e.g., AWS, Azure and GCP).
- Certification in Hadoop, Hive, or PySpark.

This

**Benefits**:

- What a Consulting role at Thoucentric will offer you?
- Opportunity to define your career path and not as enforced by a manager.
- A great consulting environment with a chance to work with Fortune 500 companies and startups alike.
- A dynamic but relaxed and supportive working environment that encourages personal development.
- Be part of One Extended Family. We bond beyond work - sports, get-togethers, common interests etc.
- Work in a very enriching environment with Open Culture, Flat Organization and Excellent Peer Group.
- Be part of the exciting Growth Story of Thoucentric

Practice Name

Data Engineering

Work Mode

Hybrid

Industry

Consulting

Corporate Office

Thoucentric, The Hive, Mahadevapura

Zip/Postal Code

560048

City

Bangalore North

Country

India

State/Province

Karnataka

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India TE Connectivity Full time

    Data Engineer Role OverviewAt TE, we are looking for a Senior Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing data lakes, managing data flows that integrate information from various sources into a common data lake platform through an ETL Tool.Key ResponsibilitiesDesign and develop data lakes on AWS...

  • Azure Ml Architect

    5 months ago

    Bengaluru, Karnataka, India growel softech Full time

    **Azure ML Architect **JD Requirements : Azure ML Architect which Experience on Data Bricks Development platform.** **Location : Bangalore** **Prior Experience** - 5+ years’ Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks ML platform. - Expert level in Designing and Architect solutions in Azure Data...

  • Data Architect

    4 weeks ago

    Bengaluru, Karnataka, India Trianz Full time

    Job Title: Data ArchitectTrianz is a leading-edge technology platforms and services company that accelerates digital transformations at Fortune 100 and emerging companies worldwide in data & analytics, digital experiences, cloud infrastructure, and security.Job Responsibilities:Architect secure, scalable, highly performant data engineering and management...

  • Delta Air Lines

    2 weeks ago

    Bengaluru, India Hirist.tech Full time

    About the Company :Delta Air Lines (NYSE : DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting...

  • Databricks Architect

    5 months ago

    Bengaluru, India Tarento Group Full time

    Bachelor's or Master's degree in Computer Science, Information Technology. - 8+ years of experience in Data warehousing - Proven experience as a Databricks Architect or a similar role, with hands-on experience in architecting and implementing data analytics solutions on the Databricks platform. - Design and develop scalable data pipelines, data lake...

  • Senior Data Solutions Architect

    2 weeks ago

    Bengaluru, Karnataka, India Synechron Full time

    Job Title: Senior Data Solutions ArchitectJob Summary:We are seeking a highly experienced Senior Data Solutions Architect to join our team at Synechron. As a Senior Data Solutions Architect, you will be responsible for designing, architecting, and implementing large-scale data lake solutions using Hadoop for on-premise systems and cloud data architectures on...

  • Data Architect

    4 weeks ago

    Bengaluru, Karnataka, India Synechron Full time

    About the RoleWe are seeking a highly skilled Data Architect to join our team at Synechron. As a Data Architect, you will be responsible for designing and implementing large-scale data lake solutions using Hadoop for on-premise systems and cloud data architectures on Azure or AWS.Key ResponsibilitiesDesign and architect data platforms in cloud environments,...

  • Technical Architect

    1 month ago

    Bengaluru, India Delta Air Lines Full time

    About Delta Tech Hub:Delta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting...

  • Technical Architect

    2 months ago

    Bengaluru, India Delta Air Lines Full time

    About Delta Tech Hub:Delta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting...

  • Technical Architect

    2 months ago

    Bengaluru, India Delta Air Lines Full time

    About Delta Tech Hub: Delta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of...

  • Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India Trianz Full time

    Data ArchitectTrianz is a leading-edge technology platforms and services company that accelerates digital transformations at Fortune100 and emerging companies worldwide in data & analytics, digital experiences, cloud infrastructure, and security. The company's vision, strategy, and business model are based on insights from a recent global study spanning 20+...

  • Senior Data Engineer for Databricks and Data Lakes

    2 weeks ago

    Bengaluru, Karnataka, India NR Consulting - India Full time

    Job Title: Senior Data Engineer for Databricks and Data LakesLocation: BangaloreExperience: 8-11 yearsJob Description:- 9 to 12 years of experience in developing data lakes and data marts on Databricks, with expertise in ETL tools like Azure Data Factory, Informatica, and Spark.- Develop and maintain ETL processes using Databricks notebooks, implement and...

  • Data Architect

    4 weeks ago

    Bengaluru, Karnataka, India Synechron Full time

    About the RoleWe are seeking a highly skilled Data Architect to join our team at Synechron. As a Data Architect, you will be responsible for designing, architecting, and implementing large-scale data lake solutions using Hadoop for on-premise systems and cloud data architectures on Azure or AWS.Key Responsibilities:Design and implement data platforms in...

  • Senior Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India TE Connectivity Full time

    Overview At TE, we are seeking a highly skilled Senior Data Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing scalable data lakes, managing data flows, and ensuring seamless integration of information from various sources into our common data lake platform. Key Responsibilities ...

  • Senior Data Architect

    3 weeks ago

    Bengaluru, Karnataka, India TE Connectivity Full time

    Unlock Your Potential at TEAt TE, we're looking for a talented Senior Data Architect to join our team. As a key member of our data engineering team, you will play a crucial role in designing and developing our data lakes, managing data flows, and integrating information from various sources into a common data lake platform.Key Responsibilities:Design and...

  • Data Architect Position

    2 weeks ago

    Bengaluru, Karnataka, India Synechron Full time

    Welcome to Synechron, a global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions. We have an immediate opportunity for a seasoned Data Architect to join our team.About the Role:As a Data Architect, you will be responsible for designing, architecting, and implementing large-scale data lake...

  • Data Architect

    5 months ago

    Bengaluru, Karnataka, India Compendious Med Works Full time

    **Roles and Responsibilities**: - Subject matter expertise in design of data models for enterprise analytics to align with standards that will enable conformance and usability across the enterprise landscape. - Responsible for data-field level data-mappings, vocabulary consistency and transformations via complex analytical relationships/access paths,...

  • Data Architect

    3 weeks ago

    Bengaluru, Karnataka, India Trianz Full time

    Job Title: Data ArchitectAbout the Role:Trianz is a leading-edge technology platforms and services company that accelerates digital transformations at Fortune 100 and emerging companies worldwide in data & analytics, digital experiences, cloud infrastructure, and security. We are seeking a talented Data Architect to join our team and help us deliver...

  • Data Architect

    4 weeks ago

    Bengaluru, Karnataka, India Trianz Full time

    Job Title: Data ArchitectTrianz is a leading-edge technology platforms and services company that accelerates digital transformations at Fortune 100 and emerging companies worldwide in data & analytics, digital experiences, cloud infrastructure, and security. The company's "IP Led Transformations" vision, strategy, and business model are based on insights...

  • Delta Cloud Modernization Architect

    1 week ago

    Bengaluru, Karnataka, India Hirist Full time

    About the Company :Delta Air Lines, the U.S. global airline leader in safety, innovation, reliability and customer experience, is seeking a highly skilled Enterprise Software Architect to join our Cloud Transformation team in Bangalore. As a key member of our team, you will play a crucial role in modernizing our cloud infrastructure and developing innovative...