Pyspark Architect

Cognisol is seeking a talented PySpark Architect to drive the design and implementation of our big data systems. As a key member of our data engineering team, you will use your expertise in PySpark, Apache Spark, and Python programming to develop efficient data processing tasks and ensure seamless data migration, transformation, and integration for our data...

Job Description :We are looking for an experienced Lead Data Engineer to join our dynamic team and help us build innovative data engineering solutions that empower businesses to leverage the full potential of their data. As a Lead Data Engineer, you will be responsible for building scalable data pipelines, managing large datasets, and designing end-to-end...

Job Overview:We are seeking an experienced Cloud-based Data Platform Leader to join our team at Thryve Digital Health LLP. As a key member of our data engineering team, you will be responsible for leading the creation and maintenance of reusable data pipelines using Databricks (PySpark) and GCP. Your role will involve managing the work end-to-end,...

About This RoleHiring Manager at Hub Work: We are seeking an experienced Cloud Data Architect to join our team. As a key member of our cloud architecture group, you will be responsible for designing, developing, and implementing end-to-end data ingestion and processing systems on the AWS platform.The ideal candidate will have 10+ years of experience in data...

**Job Description:**We are seeking a highly skilled Snowflake Datawarehousing Expert to join our team at LTIMindtree.As a Data Architect, you will be responsible for designing and implementing Snowflake data warehouses using Data Vault modeling or Terraform. Your expertise in CI/CD pipeline building and hands-on experience with infrastructure as code is...

Job Description:Sentient Scripts Private Limited is seeking a skilled database developer to design, develop, and maintain database solutions using Snowflake, ADF, Pyspark, and Databricks. The ideal candidate will have a strong background in database development and data engineering.Responsibilities:Design, develop, and maintain database solutions using...

About the Role :We are seeking a highly experienced and driven Data/Solution Architect to join our team. You will play a critical role in shaping our data strategy, designing robust big data solutions, and ensuring alignment between business needs and technical implementations. This role requires a deep understanding of data architecture principles, hands-on...

Job Description10 plus years of experience in Data Engineering with solid experience in design, development and implementation of end-to-end data ingestion and data processing system in AWS platform.2-3 years of experience in AWS Glue, Lambda, Appflow, EventBridge, Python, PySpark, Lake House, S3, Redshift, Postgres, API Gateway, CloudFormation, Kinesis,...

10 plus years of experience in Data Engineering with solid experience in design, development and implementation of end-to-end data ingestion and data processing system in AWS platform. 2-3 years of experience in AWS Glue, Lambda, Appflow, EventBridge, Python, PySpark, Lake House, S3, Redshift, Postgres, API Gateway, CloudFormation, Kinesis, Athena, KMS,...

Job DescriptionWe're seeking a highly skilled AWS Data Engineer to join our team at Hub Work. As an AWS Data Engineer, you'll be responsible for designing, developing, and maintaining large-scale data processing systems on AWS. You'll work closely with our data architects and engineers to ensure that our data solutions meet the needs of our clients.Key...

Job DescriptionIncedo Inc. is a leading company that leverages the power of technology to drive innovation and growth. We are seeking a highly skilled GCP Data Engineer to join our team and play a key role in shaping the future of our cloud infrastructure.We are looking for an experienced professional with a strong background in GCP and BigQuery who can...

Summary:•Analyze, Organize data and Build data systems with multiple data sources•Working closely with Platform team, and Market for the Data sibilities (are not limited to):•Analyze and organize raw data•Build data systems and pipelines• Evaluate business needs and objectives•Conduct complex data analysis and report on results•Prepare data...

At HTC Global Services, we are seeking an AWS Data Engineer with a strong background in cloud computing and data processing. In this role, you will be responsible for designing, implementing, and managing scalable and secure data systems on Amazon Web Services (AWS).We are looking for a highly skilled professional who is proficient in AWS services such as...

Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...

About Tata Consultancy ServicesWe are a global IT consulting and business solutions organization that enables our clients' success by leveraging our expertise in consulting, enterprise solutions, business process outsourcing, and next-generation technologies.Job DescriptionThe ideal candidate should have a strong background in cloud computing, particularly...

We are seeking a seasoned Senior Big Data Specialist Role to join our team at Tata Consultancy Services Limited. In this role, you will be responsible for architecting and delivering big data solutions using Azure Databricks and other related technologies.The ideal candidate will have 7-10 years of experience in big data engineering, with expertise in...

• Azure Data Factory • Azure Databricks • Python, Scala, PySpark, Spark • HIVE / HIVE LLAP / HBASE / CosmoDb • Azure Active Directory Domain Services • Apache Ranger / Apache Ambari • Azure Key Vault • Expertise in HDInsight ( Minimum 2 -3 years ' experience with multiple implementations ) • Expertise in Cloud Native and Open Cloud...

Job Title : Data Lead / ArchitectExp Level : 10 to 15 yearsJob Location : Coimbatore, Onsite Work from Office onlyJob Type : Full-TimeJob Summary : The Data Architect will be responsible for designing, creating, deploying, and managing the organization's data architecture. This includes defining how the data will be stored, consumed, integrated, and managed...

Job DescriptionKey Responsibilities- Design, develop, and maintain ETL pipelines using AWS Glue to support data integration and transformation needs.- Build scalable and efficient data processing solutions leveraging AWS Glue's ETL capabilities.- Write complex PySpark or Scala scripts for data extraction, transformation, and loading processes.- Collaborate...

Job Description:We are seeking an experienced Azure Data Engineer to join our team at Tata Consultancy Services. In this role, you will be responsible for designing and implementing scalable data solutions using Azure technologies such as Azure Data Lake Storage-Gen 2, SQL Database, and Azure Data Factory.Key Responsibilities:Develop and maintain Azure Data...