Airflow Developer
1 week ago
The ideal candidate will be responsible for developing high-quality applications. They will also be responsible for maintain & enhance the script.
Role Description :
Requirements:
• Technical Skills:
o Proficiency in Airflow and Python scripting, with experience in developing DAG for automation.
o Proficiency in PowerShell scripting with experience in managing Windows-based systems.
o Familiarity with Linux scripting (Bash) is a plus.
o Experience with REST APIs developing and using them within automation scripts.
• Infrastructure and Automation Tools:
o Experience working with cloud platforms (e.g., AWS, Azure, Google Cloud) and related automation.
o Familiarity with configuration management tools (e.g., Ansible) and CI/CD pipelines (e.g., ArgoCD, Github).
o Knowledge of containerization tools (e.g. Kubernetes, Docker) is a plus.
• Other Qualifications:
o Strong problem-solving skills and attention to detail.
o Excellent communication skills and ability to work in a collaborative environment.
o Previous experience in DevOps or System Administration roles is a plus.
Responsibilities:
• Script Development and Automation:
o Develop, maintain, and enhance scripts using PowerShell and Python for automating system administration tasks, data processing, and infrastructure management.
o Automate operational workflows, deployments, and monitoring tasks to improve team productivity and operational efficiency.
• Infrastructure Management:
o Implement, maintain, and optimize server management tasks, user provisioning, and system updates across various environments.
o Collaborate with infrastructure and DevOps teams to manage, monitor, and troubleshoot environments using automated solutions.
• Security and Compliance:
o Ensure scripts and automation solutions follow security best practices, including secure credential handling, access control, and audit logging.
o Participate in security and compliance checks, reviews, and improvements related to scripts and automation tools.
• Collaboration and Documentation:
o Work closely with development, operations, and security teams to gather requirements, understand workflows, and deliver appropriate automation solutions.
- o Document all developed scripts, tools, and processes clearly to support knowledge transfer and system maintainability.
-
OSD Data Services | Data Platform Engineer
2 days ago
rajahmundry, India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...