Data Engineer - AWS/Databricks - Mid Level

<h2>Overview</h2> <p>Acuity Inc. is seeking a highly skilled Data Engineer to join our Engineering Team, helping drive the design and delivery of AWS cloud-scale data platforms for federal clients. This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines on Databricks. The ideal candidate brings both engineering and strategic insight into enterprise data modernization.</p> <h2>Why Acuity?</h2>Are you ready to use your expertise in the areas of IT Modernization, Data Enablement, and Hyperautomation to make a real difference? Join Acuity, Inc., a technology consulting firm that supports federal agencies. We combine industry partnerships and long-term federal experience with innovative technical leadership to support our customers’ critical missions. <h2>Responsibilities</h2> <ul> <li>Build and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data.</li> <li><p>Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets.</p></li> <li><p>Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture.</p></li> <li><p>Leverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices.</p></li> <li><p>Collaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control.</p></li> <li><p>Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning.</p></li> <li><p>Deploy and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as GitLab or Jenkins.</p></li> <li><p>Monitor pipeline health, job execution, and cluster utilization using native Databricks tools and AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffs.</p></li> <li><p>Conduct technical discovery and mapping of legacy source systems, identifying required transformations and designing end-to-end data flows.</p></li> <li><p>Implement governance practices including metadata tagging, data quality validation, audit logging, and lineage tracking using platform-native features and custom logic.</p></li> <li><p>Support ad hoc data access requests, develop reusable data assets, and maintain shared notebooks that meet operational reporting and analytics needs across teams.</p></li> </ul> <h2>Qualifications</h2> <ul> <li>4+ years of experience in data engineering and Agile analytics</li> <li>4+ years of experience creating software for retrieving, parsing and processing structured and unstructured data</li> <li>2+ years of experience building scalable ETL and ELT workflows for reporting and analytics</li> <li>2 + years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks</li> <li>Experience with data quality, validation frameworks, and storage optimization strategies</li> <li>BA or BS degree</li> </ul> <p>Clearance Requirement:</p> <ul> <li>Must be US Citizen with an ability to obtain and maintain US Suitability</li> </ul> <p> </p> <p> </p> <p> </p> <p><strong>About Acuity</strong></p> <p>At Acuity, your work matters—and so does your experience. We’re a management and technology consulting firm supporting critical federal missions, where you’ll have the opportunity to solve meaningful challenges, work alongside high-performing teams, and make a real impact from day one.</p> <p> </p> <p> </p> <p><strong>Why You’ll Love Working Here:</strong></p> <p> </p> <p><strong>Grow Your Career, Your Way</strong>We invest in you with personalized development plans, mentorship, and up to $3,000 annually for training and certifications and up to $3,000 for degree seeking programs—so you can keep building the career you want.</p> <p> </p> <p><strong>Be Part of Something Innovative</strong>You’ll work on cutting-edge solutions that support important government missions, in an environment that encourages new ideas and continuous improvement.</p> <p> </p> <p><strong>Thrive in a People-First Culture</strong>Collaboration, respect, and support aren’t just values—they’re how we operate. Your voice is heard, your contributions are recognized, and your success is shared.</p> <p> </p> <p><strong>Feel Valued and Rewarded</strong>We offer competitive compensation, comprehensive benefits, and a strong focus on work-life balance so you can perform at your best—at work and at home.</p> <p> </p> <p><strong>Join an Award-Winning Team</strong>Our employees consistently rank us among the best—earning honors like <em>Best Places to Work</em> (Washington Business Journal, 9+ years) and <em>Top Workplaces</em> (The Washington Post, 2022–2025).</p> <p> </p> <p><strong>Bring Your Whole Self to Work</strong>We’re committed to building a diverse, inclusive environment where everyone feels respected, supported, and empowered to succeed.</p> <p> </p> <p><strong>Make Your Impact</strong></p> <p>Join Acuity and be part of a team where your ideas are valued, your growth is supported, and your work drives meaningful outcomes.</p> <p>Learn more: www.myacuity.com</p> <p> </p> <p><em>Acuity is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.</em></p> <p> </p> <p> </p> <p> </p> <p> </p> <p><strong>Recruiting Scams and Fraud</strong></p> <p>Acuity Inc. has been made aware of fraudulent job postings and individuals impersonating company recruiters. These scams may include fake job offers, requests for sensitive personal information, or demands for payment.</p> <p> </p> <p>Please note:</p> <ul> <li><strong>Acuity never asks candidates to pay</strong> for job applications, equipment, or training.</li> <li><strong>All official communications</strong> will come from an <strong>@myacuity.com</strong> email address.</li> <li>If you are unsure about a job posting or recruiter, please verify the opportunity on our <strong>Careers page</strong>.</li> </ul> <p>If you believe you have been targeted by a scam or have concerns about the authenticity of a job listing claiming to represent Acuity Inc., please contact us at<strong> careers@myacuity.com</strong>. Protecting your security and trust is important to us.</p> <p> </p> <p> </p> <p><em>#LI-PA1</em></p> <p><em>#LI-Remote</em></p>

Back to blog

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...