Freelance PowerShell ETL Developer for API Data Integration

1 week ago


India ThreatXIntel Full time

Job Description

Company Description

ThreatXIntel is a startup cyber security company that offers customized and affordable solutions to protect businesses from cyber threats. With a proactive approach to security, we continuously monitor and test our clients' digital environments to identify vulnerabilities. Our mission is to provide exceptional cyber security services to give our clients peace of mind and the freedom to focus on growing their business.


Role Description

This is a part-time remote role for a PowerShell Developer for API Data Integration & ETL Pipelines at ThreatXIntel. The developer will be responsible for creating and maintaining PowerShell scripts for data integration and ETL pipelines. Day-to-day tasks include API integration, data transformation, and troubleshooting to ensure efficient data processing.


Key Responsibilities:

  • Develop and maintain PowerShell scripts for API data extraction (e.g., Dynatrace, VMware, ServiceNow).
  • Convert API data into PowerShell data table objects and perform bulk insertions into staging tables.
  • Design and implement flexible, scalable ETL pipelines that adapt to API changes.
  • Create and manage staging tables, as well as data warehouse models (fact, dimension, and measure tables).
  • Write and optimize stored procedures for data transformation and final table insertion.
  • Optimize data ingestion using parallel processing and data chunking techniques.
  • Ensure reliability and scalability of ETL processes for large datasets (billions of records).


Skills & Technologies:

  • Languages: Windows PowerShell, Python
  • Tools: SQL Server, Dynatrace API
  • Methods: Bulk insert, parallel processing, API data integration, data warehousing
  • Database Skills: T-SQL, stored procedures, indexing, partitioning, normalization
  • Performance Optimization: Error handling, logging, and monitoring for high-volume ETL jobs




  • India ThreatXIntel Full time

    Company Description ThreatXIntel is a startup cyber security company dedicated to protecting businesses and organizations from cyber threats. The company offers a range of services including cloud security, web and mobile security testing, and DevSecOps. ThreatXIntel takes a proactive approach to security by continuously monitoring and testing clients'...


  • India ThreatXIntel Full time

    Company Description ThreatXIntel is a startup cyber security company dedicated to protecting businesses and organizations from cyber threats. The company offers a range of services including cloud security, web and mobile security testing, and DevSecOps. ThreatXIntel takes a proactive approach to security by continuously monitoring and testing clients'...


  • India ThreatXIntel Full time

    Job Description Company Description ThreatXIntel is a startup cyber security company that offers customized and affordable solutions to protect businesses from cyber threats. With a proactive approach to security, we continuously monitor and test our clients' digital environments to identify vulnerabilities. Our mission is to provide exceptional...

  • RPA DataLoader

    3 months ago


    Anywhere in India/Multiple Locations Gama Advisory Services LLP Full time

    Overview :We are looking for a skilled RPA DataLoader with 2-4 years of experience in data integration to join our team. As an RPA DataLoader specializing in data integration, you will be responsible for designing, developing, and maintaining automated data loading processes using Robotic Process Automation (RPA) tools. Your expertise in RPA and data...

  • ETL Testing

    6 days ago


    india Trigent Software Private Limited Full time

    Location Primary Skills No of Position High level JD Pune ETL-Testing 1 Develop and execute test plans and test cases for (1) ETL processes to ensure data accuracy, completeness and integrity (2) Java code to esure fnctionality, performance and reliability Validate data transformations , mappings and data loads Perform...


  • India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup cyber security company that specializes in protecting businesses and organizations from cyber threats. Our services include cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We provide customized and affordable solutions to meet the specific needs of our clients, regardless...


  • India ThreatXIntel Full time

    Company Description ThreatXIntel is a startup cyber security company that specializes in protecting businesses and organizations from cyber threats. Our services include cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We provide customized and affordable solutions to meet the specific needs of our clients,...

  • ETL Developer

    1 week ago


    india Ingrain Systems Inc Full time

    We are seeking a Data stage Developer(ETL Developer) to become an integral part of our team! Location :Hyderabad Experience: 5+ Years Technical Knowledge and Skills: · Extensive hands-on experience in building ETL interfaces using Datastage to aggregate, cleanse and migrate data across Data Warehousing systems using staged data processing techniques,...


  • India Brenntag Full time

    Job Summary:We are looking for a skilled Salesforce Data Integration Lead Developer to lead the design and implementation of a robust data integration solution between our SAP and Salesforce environments. The ideal candidate will have a strong background in Salesforce data modeling, managed packages, and SAP data models.Responsibilities:Data Analysis and...

  • ETL Developer

    3 weeks ago


    India Comptech Associates Full time

    Job Title: ETL developer Location: Remote (India) Duration: 6+ Months Job Description: Looking for an ETL developer who will be responsible for pulling employee and related retail store data from the database and transforming that data into comprehensive reports and knowledge on star and snowflake schemas. Job responsibilities include designing and creating...

  • ETL Developer

    2 weeks ago


    India Comptech Associates Full time

    Job Title: ETL developer Location: Remote (India) Duration: 6+ Months Job Description: Looking for an ETL developer who will be responsible for pulling employee and related retail store data from the database and transforming that data into comprehensive reports and knowledge on star and snowflake schemas. Job responsibilities include designing and...

  • Integration Developer

    2 weeks ago


    India Care365 SOL Private limited Full time

    Qualifications:• Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.• Experience: 5+ years of experience in integration development or a related role.• Skills:o Proficiency in integration technologies and tools (e.g., MuleSoft, Dell Boomi, Apache Camel).o Strong programming skills in languages such as Java,...

  • Integration Developer

    2 weeks ago


    India Care365 SOL Private limited Full time

    Qualifications: • Education: Bachelor’s degree in Computer Science, Information Technology, or a related field. • Experience: 5+ years of experience in integration development or a related role. • Skills: o Proficiency in integration technologies and tools (e.g., MuleSoft, Dell Boomi, Apache Camel). o Strong programming skills in languages such as...

  • ETL Developer

    2 weeks ago


    India Talentgigs Full time

    Role: ETL Senior DeveloperExperience: 5 YearsLocation: BangaloreWork Timings: 1PM - 10PMMandatory Skills: ETL, TSQL, SSIS, SSRS, PowerBI and SSASJD:Key Responsibilities:Experience with SSIS development and enhancements would be the primaryIssue resolutions at different stages of ETL and Data from data warehouseStrong command of SSAS, SSIS, SSRS and...

  • ETL Developer

    2 weeks ago


    India Talentgigs Full time

    Role: ETL Senior Developer Experience: 5 Years Location: Bangalore Work Timings: 1PM - 10PM Mandatory Skills: ETL, TSQL, SSIS, SSRS, PowerBI and SSAS JD: Key Responsibilities: Experience with SSIS development and enhancements would be the primary Issue resolutions at different stages of ETL and Data from data warehouse Strong command of SSAS, SSIS,...


  • India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup cyber security company specializing in protecting businesses and organizations from cyber threats. Our team provides services such as cloud security, web and mobile security testing, and DevSecOps. We focus on delivering customized, affordable solutions to meet the specific needs of our clients, regardless of...


  • India ThreatXIntel Full time

    Company Description ThreatXIntel is a startup cyber security company specializing in protecting businesses and organizations from cyber threats. Our team provides services such as cloud security, web and mobile security testing, and DevSecOps. We focus on delivering customized, affordable solutions to meet the specific needs of our clients, regardless of...

  • ETL Developer

    3 weeks ago


    India Comptech Associates Full time

    About the Job: Role: ETL Developer Duration: Long Term Contract Location: Remote, IndiaJob Description:Looking for an ETL developer who will be responsible for pulling employee and related retail store data from the database and transforming that data into comprehensive reports and knowledge on star and snowflake schemas. Job responsibilities include...


  • India Leading MNC Full time

    Looking for a Freelance Backend Data Engineer to join a team of rockstar developers. The candidate should have a minimum of 4 years. of experience .There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will...

  • Data Tester Etl Tester

    3 months ago


    India Motifworks Full time

    Data Tester **Location**: Pune, Hybrid **Total experience**: 5+ years **Responsibilities**: - Overall hands-on experience in ETL Testing. - Understanding of data model, ETL architecture, Good Data warehouse concepts. - Knowledge of writing Medium to complex SQL queries. - Strong knowledge on Database concepts (DDL, DML and hands-on experience on writing...