High-Performance Data Pipeline Specialist

As a Data Engineer, you will play a pivotal role in crafting and implementing scalable data pipelines to support our growing data needs. Your expertise in Bigdata, Pyspark, Python, Hadoop/HDFS, Spark, and GCP/any cloud will enable you to collaborate with analytics and business teams to refine data models and foster data-driven decision making across the...

Big Data SpecialistWe are seeking a highly skilled professional to design, develop, and maintain robust ETL/ELT data pipelines for our organization.Key Responsibilities:Design and develop efficient ETL/ELT data pipelines using AWS services such as Lambda, DMS, and Glue.Develop and optimize Snowflake stored procedures to implement complex business logic and...

About the RoleWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in designing and implementing scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.ResponsibilitiesDesign and implement ETL/ELT pipelines using Azure Databricks and PySpark.Develop high-quality database programming...

Senior Databricks Engineer OpportunityWe are seeking a highly skilled Senior Databricks Data Engineer to join our dynamic data engineering team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Key Responsibilities:Design, develop, and maintain scalable and high-performance data pipelines using...

Freelance Data Engineer PositionWe are seeking a seasoned Freelance Data Engineer with exceptional skills in designing, building, and optimizing large-scale data pipelines. As part of our team, you will collaborate closely with internal teams and clients to deliver robust, scalable, and high-performance data solutions.Key Responsibilities:Develop ETL/ELT...

Senior Azure Databricks EngineerWe are seeking an expert Senior Azure Databricks Engineer to spearhead the design, development, and optimization of data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Design and develop scalable data ingestion pipelines for integrating multiple sources into Databricks.Implement and...

Data Engineer Job OpportunityThreatXIntel is a cyber security company focused on protecting businesses and organizations from cyber threats.We offer customized cloud security, web and mobile security testing, and DevSecOps services to meet the specific needs of our clients.A key requirement for this role is designing, developing, and optimizing data...

Data Ingestion Specialist - Join our data team to help design and develop innovative data ingestion pipelines that integrate multiple sources into Databricks.We are seeking a highly skilled Data Ingestion Specialist with hands-on experience in designing, developing, and optimizing data ingestion workflows. As an integral part of our data engineering team,...

Job Title: Senior Test EngineerWe are seeking a highly skilled professional to lead our test engineering efforts.About the Role:Key Responsibilities:Design and develop manual and automated test cases for data pipelines using Python and Pytest.Validate data transformations, mappings, and integrity through SQL queries and data profiling.Automate functional,...

Big Data DeveloperWe are seeking a highly skilled engineer to design, build and maintain robust data pipelines that handle high-volume financial data.Key ResponsibilitiesDesign, develop and manage end-to-end data pipelines for stocks, crypto and other financial datasets.Integrate third-party APIs and data feeds into internal systems.Build and optimize data...