Data Architecture Specialist

7 days ago

Bengaluru Bangalore Pune, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,00,000
Job Description

As a Data Engineer, you will be responsible for designing and implementing complex data processing pipelines to solve our clients' most complex challenges.

  • You will collaborate with your team to create scalable and efficient data pipelines that meet the requirements of our clients.
  • You will work closely with cross-functional teams to ensure seamless integration of data engineering solutions into our business operations.
  • You will leverage various continuous delivery practices to deploy, support, and operate data pipelines.
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available.
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.
  • Create data models and speak to the tradeoffs of different modeling approaches.
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process.
  • Assure effective collaboration between Thoughtworks and the client's teams, encouraging open communication and advocating for shared outcomes.
Required Skills and Qualifications
  • Good understanding of data modeling and experience with data engineering tools and platforms such as Spark (Scala) and Hadoop.
  • Built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting.
  • Hands-on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions.
  • Comfortable taking data-driven approaches and applying data security strategy to solve business problems.
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems.
  • Genuinely excited about data infrastructure and operations with a familiarity working in cloud environments.
Benefits
  • Opportunity to work with a talented team of data engineers and contribute to the development of cutting-edge data engineering solutions.
  • Chance to learn and grow with a company that values innovation and continuous improvement.
  • Collaborative and dynamic work environment that encourages open communication and knowledge sharing.
Others
  • Must Have:
  • Data Catalog - Collibra Catalog / Ab Initio / Apache Atlas.
  • Data Quality Framework Experience - Great Expectations / Collibra DQ / Ab Initio.
  • Data Lineage - Apache Atlas / Collibra.
  • Data Processing - Batch / Real.
  • Good To Have:
  • Data Security / Encryption / Tokenization - Apache Ranger.
  • Data Pipelines Orchestration.
  • Data Modelling.

  • Data Architecture Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataArchitecture Full time

    Job Title: Data Architecture SpecialistOur team is looking for a highly skilled Data Architecture Specialist to lead the design, development, and implementation of our data architecture strategy. The ideal candidate will have a strong technical background in data architecture and management, as well as excellent communication skills.Key...

  • Data Architecture Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataArchitecture Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Architecture SpecialistThis is a key role in our organization, responsible for designing and implementing data architecture solutions that meet business needs. The ideal candidate will have strong technical skills and experience in working with big data technologies.

  • Data Architecture Specialist

    2 weeks ago

    Gurgaon / Gurugram, Bengaluru / Bangalore, India beBeeData Full time

    Job Title: Data Architecture Specialist">Design and develop scalable data architectures to meet business requirements.Implement and manage big data solutions using Azure Data Lake Storage (ADLS) and Azure Databricks.Collaborate with cross-functional teams to understand data needs and deliver robust solutions.Optimize data workflows for performance,...

  • Data Architectural Specialist

    5 days ago

    Pune, Maharashtra, India beBeeDataArchitectural Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity: Data Architectural SpecialistRole Overview:We are seeking a skilled Data Architectural Specialist to lead our team in designing and developing large-scale data engineering pipelines using advanced technologies.Key Responsibilities:Design and Implement:Highly scalable and efficient data processing systems utilizing Apache Spark, Hadoop, and...

  • Data Architecture Specialist

    5 days ago

    Bengaluru, Karnataka, India beBeeDataArchitecture Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Architecture SpecialistWe are seeking a highly skilled Data Architecture Specialist to join our organization. In this role, you will be responsible for designing and implementing data architectures that meet the needs of our business.About Us:We are a leading [industry/field] company that values innovation and excellence. Our team is...

  • Data Architecture Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeArchitecture Full time US$ 1,80,000 - US$ 2,30,000

    Job Title: Data Architecture SpecialistJob Summary:We are seeking a highly skilled and motivated Data Architecture Specialist to join our team. As a key member of the Data Infrastructure and Strategy group, you will play a crucial role in revolutionizing how Operations Finance teams access and analyze data.Responsibilities:Supporting and migrating data...

  • Data Architecture Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeDataArchitecture Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Architecture SpecialistAbout the Role:We are looking for a skilled Data Architecture Specialist to design and implement efficient data pipelines.The ideal candidate will have experience in creating event-driven architectures using streaming technologies and identify opportunities for process improvements.In this role, you will build...

  • Data Architecture Specialist

    1 week ago

    Bengaluru / Bangalore, Chennai, India beBeeAnalyst Full time US$ 1,50,000 - US$ 2,00,000

    Job Title: Associate ManagerArchitectural Design: Lead the development of data analytics architectures using Microsoft technologies (e.g., Power BI, Azure Synapse Analytics, SQL Server). Define data architecture and integration strategies to meet organizational goals.Technical Leadership: Serve as a technical authority on Microsoft Analytics solutions,...

  • Data Architectural Specialist

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Architectural SpecialistElevate your career by joining our dynamic team as a Data Architectural Specialist. This exciting role requires the creation of scalable data architectures to support business growth and informed decision-making.Responsibilities:Design and implement robust data pipelines using MS Fabric, ensuring seamless integration...

  • Data Architecture Specialist

    7 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Architecture SpecialistThe ideal candidate will design and develop complex data systems, focusing on scalability, reliability, and performance.Main responsibilities include:Developing optimized SQL queries and ETL processes for big data platformsImplementing robust data security measures to protect sensitive informationMaintaining and...