Job Title: Software Engineering Lead
US Citizenship Required
Job Summary:
We are looking for an experienced and skilled Software Engineering Lead to guide and oversee our data initiatives, focusing primarily on Azure Data Lake and its related ecosystem. The ideal candidate will have advanced architectural expertise in Azure Data Lake and Databricks, a strong understanding of Azure security principles, and a demonstrated ability to lead teams in developing scalable and secure data solutions.
Key Responsibilities:
Architectural Design & Implementation:
Design and build scalable, efficient, and robust data architectures utilizing Azure Data Lake and Databricks.
Set best practices for data ingestion, storage, processing, and retrieval.
Optimize data workflows for maximum performance and cost-effectiveness.
Data Governance & Security:
Develop and enforce security protocols for Azure Data Lake, ensuring compliance with internal and regulatory standards.
Oversee role-based access control (RBAC), encryption, and other security protocols within Azure subscriptions.
Partner with security teams to conduct regular audits and vulnerability assessments.
Team Leadership & Collaboration:
Lead and mentor a team of data engineers, providing guidance and fostering growth.
Collaborate with cross-functional teams, including data scientists, business analysts, and IT, to deliver data-driven solutions.
Champion agile practices to ensure projects are completed on time and within scope.
Platform Optimization & Monitoring:
Oversee the deployment and management of Azure Data Lake and Databricks environments.
Implement systems for monitoring and alerts to ensure system reliability and performance.
Continuously evaluate and integrate new Azure services to enhance the data platform.
Strategic Planning & Roadmap Development:
Develop and execute a comprehensive roadmap for data engineering that aligns with organizational goals.
Stay informed about the latest industry trends and advancements in data engineering and Azure technologies.
Offer strategic recommendations for long-term data initiatives, including the adoption of data lakehouses and cloud optimization.
Education & Experience Requirements:
Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related discipline.
8+ years of experience in data engineering, with at least 3 years in a leadership capacity.
Extensive hands-on experience with Azure Data Lake, Databricks, and other related Azure services.
Proven track record in designing and deploying large-scale data solutions.
US citizenship required for this position.
Required Knowledge & Skills:
Technical Skills:
Proficiency in SQL.
In-depth understanding of Azure security concepts, including subscription management, RBAC, and data encryption.
Experience with data modeling, ETL pipelines, and big data technologies.
Familiarity with CI/CD pipelines and DevOps practices for data engineering.
Soft Skills:
Strong leadership and team management skills.
Excellent communication and stakeholder management capabilities.
Analytical mindset with a proactive approach to problem-solving.
Preferred Qualifications:
Azure certifications, such as Azure Data Engineer Associate or Azure Solutions Architect Expert.
Experience in implementing data lakehouse architectures.
Familiarity with data governance frameworks like GDPR, CCPA, or HIPAA.
#LI-Onsite #LI-DNI
