
Freelance Data Pipeline Architect – Cloud Security
7 days ago
At ThreatXIntel, we're on a mission to deliver high-quality cyber security services tailored to meet the specific needs of businesses and organizations. Our team offers cloud security, web and mobile security testing, and DevSecOps services.
We are seeking an experienced Freelance Data Engineer with strong expertise in Python and AWS services (S3, Glue, Step Functions, PySpark) to design, develop, and optimize data pipelines that meet our clients' unique requirements.
This role requires proficiency in pytest for testing, Git/GitHub for version control, and clear technical documentation to ensure seamless collaboration and knowledge sharing.
The ideal candidate will have:
- 5–10 years of data engineering experience, with at least 5 years in AWS ecosystem.
- Strong coding skills in Python with experience in PySpark.
- Hands-on experience with AWS Glue, Step Functions, and S3.
- Proficiency in pytest for test automation.
- Solid understanding of Git/GitHub workflows.
Responsibilities include designing and developing data pipelines using AWS Glue, PySpark, and Step Functions, implementing ETL/ELT processes, managing storage solutions, writing reusable code, implementing unit and integration tests, collaborating using Git/GitHub, creating technical documentation, and troubleshooting issues related to data pipelines and AWS services.
-
Cloud Data Architect
18 hours ago
Erode, Tamil Nadu, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Cloud Data ArchitectJob Description:We are seeking an experienced Cloud Data Architect to design and implement scalable, secure, and efficient data architectures for our cloud-based applications. The ideal candidate will have a deep understanding of cloud computing platforms, particularly AWS, and experience with designing and implementing data pipelines,...
-
Chief Cloud Architect
7 days ago
Erode, Tamil Nadu, India beBeeCloud Full time ₹ 25,00,000 - ₹ 35,00,000We are seeking a highly experienced AWS cloud architect with strong DevOps background to join us as a freelancer/part-time contractor.Key Responsibilities:Cloud ArchitectureArchitect and optimize secure, scalable AWS cloud solutions for enterprise systems and AI/ML workloads.Network DesignDesign and manage VPC networks, hybrid cloud environments, and...
-
Data Cloud Architect Professional
5 days ago
Erode, Tamil Nadu, India beBeeDataCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Unlock your potential as a Salesforce Data Cloud Architect!About the RoleWe're seeking an experienced professional to lead our data cloud initiatives and drive strategy, implementation, and optimization of Salesforce Data Cloud capabilities.Key Responsibilities:Design, architect, and implement end-to-end Salesforce Data Cloud solutions.Develop data models,...
-
Senior Cloud Data Architect
5 days ago
Erode, Tamil Nadu, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000Role Summary:We are seeking an experienced Data Architect to design and develop scalable data pipelines in cloud-based environments using GCP, AWS, or Azure.Responsibilities:Develop and implement data ingestion, transformation, and storage solutions.Design and maintain robust data systems ensuring quality, integrity, and security.Collaborate with...
-
Cloud Data Architect
1 week ago
Erode, Tamil Nadu, India beBeeDataModeler Full time ₹ 75,00,000 - ₹ 1,50,00,000About the RoleThreatXIntel, a startup focused on protecting businesses from cyber threats, is looking for an experienced Freelance Data Modeler to work remotely. The ideal candidate will have strong experience with SQL Data Warehouses, Databricks Delta Lakehouse, and other MPP databases.Main Responsibilities:Design and deliver conceptual, logical, and...
-
Data Pipeline Specialist
17 hours ago
Erode, Tamil Nadu, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 20,00,000Job Description:Seeking a data engineering professional to build scalable data pipelines and cloud-native data solutions on GCP. Ideal candidate will be proficient in Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a foundational understanding of AI/ML workflows using Vertex AI.Key Responsibilities:Design and develop robust data ingestion pipelines...
-
Seeking Experienced Data Architect
1 day ago
Erode, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Data ArchitectWe seek a seasoned Data Architect to design and implement scalable, secure data pipelines on Google Cloud Platform. The ideal candidate will have expertise in data engineering with 5+ years of experience in designing, building, and optimizing complex data architectures.
-
Cloud Data Pipeline Specialist
13 hours ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000We are seeking an experienced data engineer to lead the design, development and maintenance of large-scale data pipelines on Microsoft Azure.Key Responsibilities:Create scalable data architectures on Azure using technologies such as Azure Data Factory, Azure Databricks and Azure Synapse Analytics.Collaborate with cross-functional teams to identify business...
-
Chief Data Pipeline Architect
3 days ago
Erode, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000About the RoleWe are seeking a Senior Data Engineer to design, build, and operate scalable data pipelines.This is a critical role where you will create scalable pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated information to machine learning systems for inference.Your ResponsibilitiesDesign and...
-
Cloud Data Architect
18 hours ago
Erode, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job DescriptionAs a Data Engineer, you will play a pivotal role in designing and building robust data pipelines that power our cloud-native solutions.Our ideal candidate will have hands-on experience in building data pipelines and cloud-based data solutions, with a strong focus on developing efficient ETL/ELT workflows.Key Responsibilities:Design and develop...