AltaClaro's Journey into Data-Driven, Personalized Training for Law Firm Associates

In the legal profession, consistent and timely feedback is crucial for the growth of young attorneys. However, providing personalized feedback on a large scale can be challenging for law firms. Recognizing this need, AltaClaro embarked on a journey to develop a data-driven approach to feedback on simulated assignments. Inspired by the positive impact of self-assessments and instructor observations, BenchMark360 was created. This new feature in our platform offers standardized, objective feedback at scale, accelerating the development of young attorneys. 

The Pain Points of Legal Training Feedback

Law firms often face challenges in providing consistent and timely individual partner feedback, which is crucial for the development of new associates. Assignments and feedback are key factors in shaping better legal practitioners. However, several obstacles can hinder this process, including the fast-paced nature of client work, economic cycles, workflow or allocation, type of work needed by clients, all of which can impact assignments and feedback opportunities for new associates.

Individual partner feedback can be time-consuming for senior lawyers and is often inconsistent, resulting in associates receiving varying mentoring experiences and feedback from different partners. Additionally, scaling individual partner feedback across a group of associates is challenging, as they work with multiple partners and teams in diverse practice areas.

Partners, often preoccupied with their own workload, may not always have sufficient time to provide detailed or appropriate feedback, and they may not possess the teaching skills to effectively explain the feedback. Consequently, associate feedback is often delayed until the end of the year, which limits the opportunity for self-awareness and improvement.

The Birth of BenchMark360

AltaClaro's courses have always included simulation assignments, providing associates with hands-on experience using real-world documents and fact patterns. While live group review sessions offered general feedback, we recognized the need for more personalized insights.

Our instructors began noticing associates who struggled with these simulations, and we proactively reported these observations to firms. Practice group leaders found this information valuable, confirming that these associates often faced similar challenges in their actual work. Some firms asked us to track performance more systematically, enabling earlier intervention and support.

This feedback, coupled with requests from associates for more direct and individualized feedback on their submissions, prompted us to develop a data-driven approach. We began tracking self-assessments and instructor observations during assignment reviews, witnessing firsthand the positive impact on both associates and firms. Additionally, we observed a correlation between engagement and performance in our programs and long-term success at the firm. This further emphasized the importance of our role in identifying and addressing performance gaps early on.

These insights, along with the clear demand for more personalized feedback, inspired us to create BenchMark360.

What is BenchMark360 

BenchMark360 provides objective feedback at scale, accelerating the development of young attorneys. Much like pilots honing their skills through simulated flight training, BenchMark360 utilizes data-driven insights from simulated legal assignments to help associates identify and address skill gaps early in their careers. This empowers them to refine their skills and achieve professional standards more rapidly. 

Moreover, BenchMark360 offers a fair and objective foundation for professional development discussions, fostering more productive conversations between associates and their mentors. By pinpointing areas where associates need the most support, we enable law firms to tailor their internal training and mentoring programs for maximum efficiency and impact. 

How BenchMark360 Works

To begin, an associate completes a realistic AltaClaro legal simulation, designed to replicate the complexities of actual practice. These simulations often present incomplete client information, challenging participants to navigate real-world scenarios, identify missing facts and business issues, and address potential loopholes or gray areas.

Following the simulation, our AI-powered proprietary evaluation engine analyzes the associate's work based on a standardized rubric. This objective assessment utilizes a point system to evaluate key aspects of performance, including:

• Adherence to instructions and appropriate application of legal concepts.
• Identification of all relevant legal and business issues.
• Development of practical solutions, incorporating best practices in approach, drafting techniques, and other relevant areas.

The rubric also incorporates core competency themes such as attention to detail, client needs analysis, risk allocation, economic considerations, and effective drafting.

Our highly vetted practitioner-instructors then review the AI-generated evaluation, adding nuanced, written commentary to provide further insights. Associates receive a comprehensive feedback report encompassing:

• A detailed written evaluation of their performance on each client requirement or issue.
• A personalized feedback summary highlighting key strengths and areas for improvement.
• Performance benchmarking against established competency standards.
• Identification of specific areas where additional training or mentoring may be beneficial.

Additionally, law firms receive an aggregated report offering insights into overall cohort performance and pinpointing areas where associates may require additional support. This data-driven approach empowers firms to tailor their professional development initiatives for maximum effectiveness.

What We've Learned So Far ...

Prior to its public launch, we piloted Benchmark360 at a select group of 15 Am Law 200 firms, and the feedback from associates, partners, and professional development managers was overwhelmingly positive.

• Engagement Soared: Associates were captivated by the feedback and appreciated the opportunity to identify areas of strength and improvement, leading to more engaging and efficient mentoring sessions.

• Focused Mentoring: Mentors and associates could focus on specific topics, building upon a shared understanding, which simplified the process and saved time.

• Targeted Internal Training: When they could make the time, senior lawyers responsible for internal training no longer had to explain everything from the ground up. They could hone in on specific gap areas identified by the Benchmark360 reports. Associates came into those sessions asking better questions, knowing their strengths and gaps.

• Work Allocation Insights: Work allocation gaps were identified, revealing that some underperformers lacked sufficient workflow. Conversely, those receiving positive feedback gained confidence and sought out more work, which partners recognized and rewarded with more challenging assignments. Some were identified as overconfident, and PD managers were eager to intervene and help with their mindset.

• Learner Mindset of Associates: The learner mindset of associates became evident through their response to the feedback. Those who struggled with an assignment displayed a range of reactions, including seeking additional support or dismissing the information. This insight helps shape development initiatives to foster a growth-oriented mindset.

We are excited about this new standard we have set for legal training. As more firms adopt BenchMark360, we will continue to gather data on its positive impact and share it with the legal community. 

I want to extend my heartfelt gratitude to our entire team – the practitioners, education professionals, and technology experts who dedicate themselves to providing top-tier training experiences.

And, of course, a huge thank you to our clients. Your trust, willingness to embrace innovation, and valuable feedback have been instrumental in shaping Benchmark360 into the powerful tool it is today.

To learn more about Benchmark360, please visit: AltaClaro-Benchmark360 or feel free to reach out for a demo.