· Design and Develop Scalable Data Pipelines: Build and maintain robust data pipelines using Python to process, transform, and integrate large-scale data from diverse sources.
· Orchestration and Automation: Implement and manage workflows using orchestration tools such as Apache Airflow to ensure reliable and efficient data operations.
· Data Warehouse Management: Work extensively with Snowflake to design and optimize data models, schemas, and queries for analytics and reporting.
· Queueing Systems: Leverage message queues like Kafka, SQS, or similar tools to enable real-time or batch data processing in distributed environments.
· Collaboration: Partner with Data Science, Product, and Engineering teams to understand data requirements and deliver solutions that align with business objectives.
· Performance Optimization: Optimize the performance of data pipelines and queries to hdle large scales of data efficiently.
· Data Governance and Security: Ensure compliance with data governance and security standards to maintain data integrity and privacy.
· Documentation: Create and maintain clear, detailed documentation for data solutions, pipelines, and workflows.
· 9+ years of experience in data engineering roles with a focus on building scalable data solutions.
· Proficiency in Python for ETL, data manipulation, and scripting.
· Hands-on experience with Snowflake or equivalent cloud-based data warehouses.
· Strong knowledge of orchestration tools such as Apache Airflow or similar.
· Expertise in implementing and managing messaging queues like Kafka, AWS SQS, or similar.
· Demonstrated ability to build and optimize data pipelines at scale, processing terabytes of data.
· Experience in data modeling, data warehousing, and database design.
· Proficiency in working with cloud platforms like AWS, Azure, or GCP.
· Strong understanding of CI/CD pipelines for data engineering workflows.
· Experience working in an Agile development environment, collaborating with cross-functional teams.
· Familiarity with other programming languages like Scala or Java for data engineering tasks.
· Knowledge of containerization and orchestration technologies (Docker, Kubernetes).
· Experience with stream processing frameworks like Apache Flink.
· Experience with Apache Iceberg for data lake optimization and management.
·
Exposure to machine learning workflows and integration with data pipelines.
Soft Skills:
· Strong problem-solving skills with a passion for solving complex data challenges.
· Excellent communication and collaboration skills to work with cross-functional teams.
· Ability to thrive in a fast-paced, innovative environment.
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 36,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa is an Equal Opportunity Employer. All applicants will receive fair and impartial treatment without regard to race, color, religion, sex, national origin, ancestry, age, legally protected physical or mental disability, protected veteran status, status in the U.S. uniformed services, sexual orientation, gender identity or expression, marital status, genetic information or on any other basis which is protected under applicable federal, state or local law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government-issued ID during each interview. All candidates must be authorized to work in the USA.
Learn more
Have any questions?
To join our bright team of professionals, you can apply directly to our website under the Careers tab and search all open jobs. https://www.virtusa.com/careers
Yes, you can. Virtusa gives you the flexibility to apply for multiple open positions that excite you about your future and align to your experience and career goals.
Yes, you can. Virtusa is a global Company, and we serve our clients through our global delivery model.
Our dedicated recruitment team will review your online application and match it to all our open jobs. We update our open jobs on a daily basis and encourage you to check back often.
Our team of recruiters will review your application, relevant job experience, and skills to appropriately align it to our open jobs. From there, the recruitment team will contact the qualified candidate to start the interview process.
Want to explore the ways you can engineer your career in technology? Our thought leaders share key career insights for candidates from entry-level job seekers to senior technologists.
Check your downloads folder for files and implementation instructions.
Assets are now available in your profile for future editing and use.