Data Pipeline Specialist

Big Data SpecialistWe are seeking a highly skilled professional to design, develop, and maintain robust ETL/ELT data pipelines for our organization.Key Responsibilities:Design and develop efficient ETL/ELT data pipelines using AWS services such as Lambda, DMS, and Glue.Develop and optimize Snowflake stored procedures to implement complex business logic and...

As a Data Engineer, you will play a pivotal role in crafting and implementing scalable data pipelines to support our growing data needs. Your expertise in Bigdata, Pyspark, Python, Hadoop/HDFS, Spark, and GCP/any cloud will enable you to collaborate with analytics and business teams to refine data models and foster data-driven decision making across the...

Data Engineer Job OpportunityThreatXIntel is a cyber security company focused on protecting businesses and organizations from cyber threats.We offer customized cloud security, web and mobile security testing, and DevSecOps services to meet the specific needs of our clients.A key requirement for this role is designing, developing, and optimizing data...

Job Title:Data Engineering Specialist Job Description:We are seeking a skilled Data Engineer to join our team in designing, building, and maintaining robust data pipelines. The ideal candidate will have expertise in cloud-based data processing technologies using GCP, AWS, or Azure. This role involves working on cutting-edge data infrastructure with a...

Senior Azure Databricks EngineerWe are seeking an expert Senior Azure Databricks Engineer to spearhead the design, development, and optimization of data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Design and develop scalable data ingestion pipelines for integrating multiple sources into Databricks.Implement and...

Senior Databricks Engineer OpportunityWe are seeking a highly skilled Senior Databricks Data Engineer to join our dynamic data engineering team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Key Responsibilities:Design, develop, and maintain scalable and high-performance data pipelines using...

Freelance Data Engineer PositionWe are seeking a seasoned Freelance Data Engineer with exceptional skills in designing, building, and optimizing large-scale data pipelines. As part of our team, you will collaborate closely with internal teams and clients to deliver robust, scalable, and high-performance data solutions.Key Responsibilities:Develop ETL/ELT...

Job Title: Senior Test EngineerWe are seeking a highly skilled professional to lead our test engineering efforts.About the Role:Key Responsibilities:Design and develop manual and automated test cases for data pipelines using Python and Pytest.Validate data transformations, mappings, and integrity through SQL queries and data profiling.Automate functional,...

About Data ProcessingData processing is a critical function in transforming online content into tangible business results. It involves the analysis of massive amounts of data to provide actionable insights to clients.Job Role:We are seeking an experienced Senior Data Engineer to help us scale and optimize our data processing capabilities. As a key member of...

Data Ingestion Specialist - Join our data team to help design and develop innovative data ingestion pipelines that integrate multiple sources into Databricks.We are seeking a highly skilled Data Ingestion Specialist with hands-on experience in designing, developing, and optimizing data ingestion workflows. As an integral part of our data engineering team,...