Databricks Architect
3 weeks ago
Job Description :
Function : Technical Management - Engineering Management, Software Engineering - Backend Development, Big Data / DWH / ETL
Responsibilities :
- Design and implement large-scale data processing systems using the Databricks platform.
- Work closely with clients to understand their requirements and design solutions that meet their needs.
- Collaborate with data engineers and data scientists to develop and implement data pipelines.
- Ensure the security and reliability of data processing systems.
- Optimize data processing systems for performance and scalability.
- Keep up-to-date with emerging technologies and industry trends related to big data.
Requirements :
- Bachelor's degree in Computer Science or related field.
- At least 5 years of experience in designing and implementing big data processing systems.
- Strong knowledge of Apache Spark and the Databricks platform.
- Experience with data modeling, data warehousing, and data architecture.
- Experience with cloud-based data processing systems (AWS, Azure, GCP).
- Excellent communication and collaboration skills.
- Ability to work independently and as part of a team.
- Experience with Python, Java, or Scala programming languages is a plus.
- Programming in Python, and SQL is a must with experience in Scala/Spark or pyspark.
- Design on following Databricks constructs - Workflows, Delta Lake, Delta Live Tables.
- High expertise in Optimize, Vacuum, TimeTravel, etc. to tune the Deltalake.
- Design on Datamarts in the warehouse.
- High expertise in Structured Streaming and Watermarking.
Good to have :
- ThoughtSpot & HighTouch design with data bricks.
- If you are passionate about big data technologies and enjoy working in a collaborative environment, we encourage you to apply for this exciting opportunity to be our Databricks Architect.
-
AWS Architect
3 weeks ago
Bangalore, Karnataka, India Freelancer Recruiter Full timeOver 10-14 years of IT experience- Deep expertise in S3, Redshift, Spectrum, Glue, SQS, and SNS services.- Very good Data lake concepts and at least 1 end to end project of data lake using AWS- Deep understanding of architecture and work experience on Databricks, hands-on programming with Data Frames, Python, Scala.- Experience with large data sets, data...
-
AWS Architect
2 months ago
Bangalore, Karnataka, India Freelancer Recruiter Full timeOver 10-14 years of IT experience- Deep expertise in S3, Redshift, Spectrum, Glue, SQS, and SNS services.- Very good Data lake concepts and at least 1 end to end project of data lake using AWS- Deep understanding of architecture and work experience on Databricks, hands-on programming with Data Frames, Python, Scala.- Experience with large data sets, data...
-
Unison Consulting
2 months ago
Bangalore, Karnataka, India Unison consulting pte ltd Full timeAbout the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....
-
Unison Consulting
3 weeks ago
Bangalore, Karnataka, India Unison consulting pte ltd Full timeAbout the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....
-
Azure Databricks Engineer
4 days ago
Bangalore, Karnataka, India LOGIC PLANET IT SERVICES Full timeOur client is a global technology company, home to more than 227,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products.Role : Azure Databricks. Location : Bangalore / PAN India. Experience : 15 years. Mode of hire : FTE /...
-
Data Architect
3 weeks ago
Bangalore, Karnataka, India Indium Software Full timeJob Description :We are looking for a highly experienced Data Architect to join our team. The ideal candidate will have over a decade of experience with Big Data technologies, including Apache Spark, Kafka, Cloud Native solutions, and Data Lakes. This role involves working in a customer-facing, post-sales capacity, focusing on technical architecture and...
-
Data Architect
3 weeks ago
Bangalore, Karnataka, India Indium Software Full timeJob Description :We are looking for a highly experienced Data Architect to join our team. The ideal candidate will have over a decade of experience with Big Data technologies, including Apache Spark, Kafka, Cloud Native solutions, and Data Lakes. This role involves working in a customer-facing, post-sales capacity, focusing on technical architecture and...
-
Data Architect
2 months ago
Bangalore, Karnataka, India SGS Technical Services Pvt. Ltd Full timeExperience : Total 10+ Years of experience Job Title : Data ArchitectLocation : Bangalore Job Type : Permanent Work Mode : HybridNotice period : Immediate to 30 DaysJob Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. The candidate is someone with a proven...
-
Data Architect
3 weeks ago
Bangalore, Karnataka, India SGS Technical Services Pvt. Ltd Full timeExperience : Total 10+ Years of experience Job Title : Data ArchitectLocation : Bangalore Job Type : Permanent Work Mode : HybridNotice period : Immediate to 30 DaysJob Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. The candidate is someone with a proven...
-
Data Architect
3 days ago
Bangalore, Karnataka, India Visionyle Solutions Full timePosition : Data ArchitectExperience: 10+ YearsLocation : Bangalore, HybridNotice Period: Immediate Joiners to 30 daysMode of Interview : 2-3 roundsKey Skills : Snowflake or Databricks, Python or Java, Cloud, Data Modeling As Data ArchitectPrimary Skills :- Erwin tool- Data Modeling (Logical, Physical) - 2+ years- Snowflake - 2+ years- Warehousing Concepts...
-
Data Architect
2 months ago
Bangalore, Karnataka, India Augmentedresourcing Pvt. Ltd. Full timeData Architect for our MNC Client Based in Bangalore.Job Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. The candidate is someone with a proven record of technology project execution for data on the cloud, able to get hands-on when it comes to analysis...
-
Data Architect
3 weeks ago
Bangalore, Karnataka, India Augmentedresourcing Pvt. Ltd. Full timeData Architect for our MNC Client Based in Bangalore.Job Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. The candidate is someone with a proven record of technology project execution for data on the cloud, able to get hands-on when it comes to analysis...
-
Azure GenAI Architect
4 days ago
Bangalore, Karnataka, India RapidBraiins Full timeJob Description :- Architect end to end generative AI solutions on Microsoft Azure platform including data ingestion model training deployment and monitoring.- Design and implement scalable and efficient AI pipelines utilizing Azure ML Azure Databricks Azure Cognitive service.- Explore and evaluate new AI Technologies frameworks and methodologies to enhance...
-
Data Architect
3 weeks ago
Bangalore, Karnataka, India Visionyle Solutions Full timeKey Skills : Snowflake or Data bricks, Python or Java, Cloud, Data Modeling, As Data ArchitectJob Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. - The candidate is someone with a proven record of technology project execution for data on the cloud, able to...
-
Data Architect
3 weeks ago
Bangalore, Karnataka, India Visionyle Solutions Full timeKey Skills : Snowflake or Data bricks, Python or Java, Cloud, Data Modeling, As Data ArchitectJob Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. - The candidate is someone with a proven record of technology project execution for data on the cloud, able to...
-
Unison Consulting
2 months ago
Bangalore, Karnataka, India Unison consulting pte ltd Full timeSolution Architect We are seeking a highly skilled and experienced Solution Architect to join our dynamic team.As a Solution Architect, you will play a crucial role in designing innovative and effective solutions that meet our clients' complex business requirements.Your expertise will bridge the gap between business needs and technical implementation,...
-
Unison Consulting
3 weeks ago
Bangalore, Karnataka, India Unison consulting pte ltd Full timeSolution Architect We are seeking a highly skilled and experienced Solution Architect to join our dynamic team.As a Solution Architect, you will play a crucial role in designing innovative and effective solutions that meet our clients' complex business requirements.Your expertise will bridge the gap between business needs and technical implementation,...
-
Data Scientist
3 weeks ago
Bangalore, Karnataka, India Codersbrain technology pvt ltd Full timeTitle: Data scientist with LLM and Deep learning experiencelocation: Bengaluru Experience: 5+ YearsJob Description:(JD is similar to Azure Databrick ML, please discount Databrick and search someone who is in pure Data scientist and worked heavily in LLM and DL. 7+ yr if good profile, please send.) - Hands on experience on working in Azure cloud platform -...
-
Data Scientist
3 weeks ago
Bangalore, Karnataka, India Codersbrain technology pvt ltd Full timeTitle: Data scientist with LLM and Deep learning experiencelocation: Bengaluru Experience: 5+ YearsJob Description:(JD is similar to Azure Databrick ML, please discount Databrick and search someone who is in pure Data scientist and worked heavily in LLM and DL. 7+ yr if good profile, please send.) - Hands on experience on working in Azure cloud platform -...
-
Azure Data Engineer
2 months ago
Bangalore, Karnataka, India Talent Bee Consulting Pvt Ltd Full timeAbout the job :Ideal Candidate :- 3+ years in Azure Data Engineering- Very good at ADF (Azure Data Factory)- Hands-on experience in designing and implementing data solutions on AzureOrganization :A global provider of Automation solutions in Assembly, Inspection, and Testing for manufacturing industries. With a mission to enhance the efficiency of the...