Senior Data Engineer

Founded in 2006, ProArch began as a tight-knit team of business-minded IT professionals passionate about delivering exceptional cloud-based technology solutions. Today, we've grown into a global force spread across US, UK and India into multidisciplinary experts spanning cloud, infrastructure, data analytics, cybersecurity, compliance, and software development. Organizations turn to ProArch for forward-thinking guidance, seamless implementation, and dependable ongoing support partnering with us to reach every milestone on the path to their vision.

Our services consist of specific practice areas that are methodically designed to complement and enhance each other's effectiveness. This interconnected approach removes roadblocks and drives rapid growth and financial stability. Many of our clients leverage the full scope of our services, creating a supply chain of value that impacts the entire organization from IT to customer experience

At our core, we believe in the power of technology to transform. We're passionate about inspiring innovation that shapes our people, our clients, our partners, and the communities we serve.

Job Description:

ProArch is seeking a Senior Data Engineer with 3–5 years of experience to join our Data & Analytics practice. In this role, you will design and deliver scalable data solutions, optimize performance, and enable advanced analytics across cloud platforms. You will work with large-scale datasets, modern cloud-native technologies, and collaborate with business stakeholders to build reliable and secure data ecosystems. This position also involves mentoring junior engineers and driving best practices in DataOps and performance optimization.

Responsibilities

• Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory.
• Write efficient Python and SQL code with a focus on scalability, performance, and optimization.
• Manage Azure Data Lake for structured and unstructured data ingestion at scale (volume, variety, velocity).
• Implement CI/CD pipelines and follow DataOps practices for automation and reliability.
• Optimize data partitioning, versioning, and storage/compute costs for large-scale workloads.
• Ensure high-quality solutions through unit testing frameworks and automated validation.
• Collaborate with business teams to support analytics, reporting, and data science initiatives.
• Mentor junior engineers, sharing knowledge and promoting engineering excellence.

Requirements

• Bachelor's degree in computer science, IT, Data Engineering, or a related field.
• 5–8 years of experience in data engineering roles with proven expertise in cloud data platforms.
• Expert in Python and SQL, with strong performance optimization skills.
• Proficiency in Azure Synapse Analytics, Spark Pools, and Azure Data Factory (ADF).
• Hands-on experience with Azure Data Lake and structured ingestion at scale.
• Experience in CI/CD pipelines and applying DataOps principles.
• Ability to manage large datasets with diverse structures, velocity, and volume.

Good to Have Skills

• Experience with Delta Lake, versioned data, and advanced partitioning strategies.
• Knowledge of data governance and security implementations across platforms.
• Strong understanding of advanced data modelling (e.g., slowly changing dimensions).
• Exposure to cost optimization strategies for cloud storage and compute.
• Experience mentoring or providing technical leadership to junior engineers.

Life @ ProArch

• At ProArch, we believe our people are the key to our success. That's why we foster an environment where every employee—known proudly as a ProArchian—can grow, thrive, and make a meaningful impact.
• We empower employees to develop at their own pace through Career Pathways, a clear and supportive guide to professional progression.
• Our culture is one of positivity, inclusivity, and respect. Titles don't define how we treat each other—every ProArchian is valued equally, and collaboration across roles and teams is the norm.
• We understand that great work starts with balance. That's why we prioritize work-life harmony, offering flexible work schedules and encouraging time for what matters most.
• Beyond the workplace, ProArchians actively give back—organizing volunteer efforts and charitable initiatives that empower the communities we call home.
• And because we know that extraordinary efforts deserve recognition, we celebrate those who go above and beyond with appreciation programs.
• At ProArch, we're not just using technology to transform businesses—we're using it to create a better experience for our people, our clients, and our communities.

Competencies: 

• Excellent Communication 
• Analytical Skills 
• Negotiation Skills
• Problem Solving Skills 
• Client Engagement
• Relationship Building