Data Architect

3 weeks ago

India SourceBae Full time
Job Title:

Solution Architect Lead Data Engineer

Experience: 10 - 15 Years

Contract/ Remote

About Us:

We are a leading technology service company that provides services in the field of data science, big data, enterprise cloud, and automation. As a forward-thinking company, we leverage cutting-edge technologies to drive innovation and enhance our business processes.

Role Overview:

We are seeking a talented and experienced data & AI engineer with strong Azure cloud competencies to join our dynamic team. The successful candidate will be responsible for delivering successful projects in customer environments, bringing use cases into production, machine learning projects, and large migrations.

Key Responsibilities:

  1. Architecture and Design: Establishing architecture and target design for data engineering and machine learning projects.
  2. Requirement Analysis: Current inventory analysis, review, and formalize requirements, project planning, and execution plan.
  3. Advisory Services: Troubleshooting, performance tuning, cost optimization, operational runbooks, and mentoring.
  4. Large Migrations: Assist customers with large migrations to Databricks from Hadoop ecosystems, data warehouses, ETL engines, SAS, SQL, DW, cloud-based data platforms like Redshift, Snowflake, EMR, etc.
  5. Design, Build, and Optimize Data Pipelines: The Databricks implementation will be best in class, with flexibility for future iterations.
  6. Production Readiness: Assisting with production readiness for customers, including exception handling, production cutover, capture analysis, alert scheduling, and monitoring.
  7. Machine Learning: Build and review ML models, ML best practices, model lifecycle, ML frameworks, and deploying models in production.

Must Have:

  • Hands-on experience with distributed computing framework like DataBricks, Spark-Ecosystem (Spark Core, PySpark, Spark Streaming, SparkSQL)
  • Willing to work with product teams to best optimize product features/functions.
  • Experience on Batch workloads and real-time streaming with high volume data frequency.
  • Performance optimization on Spark workloads.
  • Environment setup, user management, authentication, and cluster management on Databricks.
  • Professional curiosity and the ability to enable yourself in new technologies and tasks.
  • Good understanding of SQL and a good grasp of relational and analytical database management theory and practice.

Key Skills:

  • Python, SQL, and Pyspark
  • Big Data Ecosystem (Hadoop, Hive, Sqoop, HDFS, Hbase)
  • Spark Ecosystem (Spark Core, Spark Streaming, Spark SQL) / Databricks
  • Azure (ADF, ADB, Logic Apps, Azure SQL database, Azure Key Vaults, ADLS, Synapse)
  • AWS (Lambda, AWS Glue, S3, Redshift)
  • Data Modelling, ETL Methodology

Requirements:

The ideal candidate will have strong skills in implementation, data governance, data modeling, presales, AWS, and Databricks. They should also be able to lead a team at an Architect level.

How to Apply:

Interested candidates should submit their CV via email or share it via WhatsApp at the company's designated contact information.

Stay Updated:

Follow us on LinkedIn for the latest job opportunities and company news.

  • Lead Data Engineer: Strategic Data Architect

    2 weeks ago

    India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...

  • Data Architect

    2 months ago

    india Velotio Technologies Full time

    Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS,...

  • Data Architect

    22 hours ago

    India IntraEdge Full time

    Job Title: Data ArchitectIntraEdge is seeking a highly skilled Data Architect to join our growing data team. As a key member of our data engineering team, you will be responsible for designing and implementing efficient, scalable, and reliable data pipelines using Snowflake and DBT.Key Responsibilities:Data Pipeline Development: Design, develop, and maintain...

  • Lead data engineer

    4 days ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Data architect

    1 week ago

    India Luxoft Full time

    Project Description: Projects are found in the most evolving area of the Investment Banking domain - Asset Management. Business is dynamic and it demands fast turn-around deliverables from the development team in a quite agile manner. The team is in a forming stage and is aimed to work on a green-field projects using latest technologies on microservices...

  • Data Architect

    5 days ago

    India Tata Consultancy Services Full time

    Job Title: Data Architect Job Location : Pune(preferred), Hyderabad (Adibatla), Bangalore, Chennai, Noida, GG7,Nagpur, Experience : 7 to 10 Years Job Description: Must-Have  In-depth understanding of database structure principles  Hands-on experience with developing Data Models, Meta-data models  Experience with Data design...

  • Data Architect

    1 week ago

    India Tata Consultancy Services Full time

    Skill: Data Architect Exp: 4-8 Location: Kochi

  • Wavicle Data Solutions | Lead Data Engineer | india

    1 week ago

    india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...

  • Wavicle Data Solutions | Lead Data Engineer | india

    2 weeks ago

    india Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Wavicle Data Solutions | Lead Data Engineer | india

    2 weeks ago

    india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...

  • Data Architect

    5 months ago

    India Artefact Full time

    Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. The backbone of our consulting missions, today our Data consulting team...

  • Lead Data Engineer

    2 weeks ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    1 week ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Data Architect

    2 weeks ago

    India Luxoft Full time

    Project Description:Projects are found in the most evolving area of the Investment Banking domain - Asset Management. Business is dynamic and it demands fast turn-around deliverables from the development team in a quite agile manner.The team is in a forming stage and is aimed to work on a green-field projects using latest technologies on microservices...

  • Data Architect

    3 weeks ago

    India SourceBae Full time

    Job Title: Data ArchitectLocation: RemoteExperience: 7+ yearsJob Description:We are seeking a skilled Data Architect to design and implement scalable data pipelines in a cloud-based environment.Key Responsibilities:Design and develop large-scale data architectures using Azure.Implement and optimize data workflows using Azure Data Factory, Azure Databricks,...

  • Data Architect

    2 days ago

    India Luxoft Full time

    Project Description: Projects are found in the most evolving area of the Investment Banking domain - Asset Management. Business is dynamic and it demands fast turn-around deliverables from the development team in a quite agile manner. The team is in a forming stage and is aimed to work on a green-field projects using latest technologies on microservices...

  • Data Architect

    1 month ago

    India Insight Global Full time

    About the Role:We are seeking a highly skilled Data Architect to join our team at Insight Global. As a Data Architect, you will be responsible for designing and implementing data models, establishing data standards, and governing data across all development.Key Responsibilities:Partner with Enterprise Architecture to create data models and establish data...

  • Data Architect

    5 months ago

    India Ciklum Full time

    Description **Ciklum** is looking for a** Data Architect** to join our team full-time in India. We are a leading global product engineering and digital services company that unites 4000+ seasoned professionals globally on various projects in healthcare, fintech, travel, sportswear, entertainment, and security. Ciklum delivers high-impact technology...

  • Data Architect

    3 weeks ago

    India Luxoft Full time

    Remote India, India Software/System Architecture BCM Industry 08/11/2024 Req. VR-108493 **Project description**: Projects are found in the most evolving area of the Investment Banking domain - Asset Management. Business is dynamic and it demands fast turn-around deliverables from the development team in a quite agile manner. The team is in a forming...

  • Data Architect

    1 month ago

    India Calsoft Full time

    Data Architect Location: Pune & Bangalore Qualifications: Minimum 8 years of experience in data architecture and analytics. In-depth knowledge of big data technologies and analytics tools, including Hadoop, Hive, Cassandra, MDM, Data Lakes, Streaming Data Management and Analytics, Spark, Kafka, Redis, Databricks. Proficient in programming languages...