Monday, April 28, 2008

Confirmation Requirements: Best Faith Formation Practices

W. Edwards Deming

Some years ago, I was working on a video documentary for Ford Motor Company about the famous American industrial statistician, W. Edwards Deming, who is credited with transforming Japan’s industrial quality after WWII, and making the Japanese the competitive powerhouse they are today. In 1950 Deming had been upset with the quality of American products and attempted to persuade American industry to implement a statistical process control system to correct the problem. But, he was rebuffed, so he went to the Japanese who listened and turned around their quality. Today the Japanese government offers The Deming Prize to individuals, applications, and companies who excel in product quality.

In the early 1980s, when the American automobile industry led the country into a recession because Japan was taking market share, Ford Motor Company invited Deming (1900-1993), also in his 80s, to teach his methods of quality control to Ford management.

One of Deming’s famous lines, which we captured in our documentary was this: “It costs just as much to make a bad part as it does a good one. So, why don’t you make a good one -- instead of a bad one?”

He pointed out management’s error in their willingness to spend 20%-40% of the cost, fixing problems or repairing parts that were made wrong, instead of investing that same money into controlling the process through regular and precise measurements, and thus improving all over productivity and quality. Today, Deming’s measurement and testing techniques are the backbone of American industry.

Deming’s techniques also have a direct application in human resource management as many companies have discovered, including training and the education of students. In this article I will explain how Deming’s insights are only common sense, and should be the backbone for the catechesis of children and adults in the Catholic Church. But first, let me tell a true, personal, and ironic story about Deming to illustrate my point.

True & Ironic

When I first met Deming, it was 1981. He was 81, tall, slightly stooped, and particular about his diet—forget the vegetables, he loved pies. He was also particular about what kind of chair he sat in. I interviewed him on the top floor of Ford Word Headquarters, just down the hall from the chairman’s office, Donald Peterson, whom we were scheduled to interview an hour after we finished with Deming. The chairs available in the executive lounge were these lush, deep plush jobs that did nothing for the posture, but they looked great on camera. We set up our camera and lights, and when Deming came he took one look at the chair I directed him to, growled, and said to me, “I will not sit in that chair. It’s bad for my back.”

I was off to a great start. The man was tired, and still slightly bitter at being rejected by U.S. industry for 30 years. We hustled and got him a proper chair, and after a few moments began the interview. Because our audience supposedly knew nothing about his history, theories or management techniques (although I had read the manuscript of his latest yet unpublished book) I began by asking the basic questions, which I knew he had answered a thousand times before. It was an error on my part not to have briefed him on who I was and my own research. He was impatient, and considered my documentary and me a waste of his time. I started to get one and two word answers. He was miffed, and I had no idea how to fix the system I had created.

After no more than ten minutes of the scheduled 45-minute interview I asked that the camera be stopped. It was useless; we were getting nothing on tape that I could use. I thanked Deming for his time, and asked the soundman to remove Mr. Deming’s microphone.

As Deming got out of the chair and began to leave I was sad at missing the opportunity to get to know this great industrialists — one of the great benefits of making documentaries is what you learn about the people you interview and the subjects you investigate. As he left the room, I leaned over into my briefcase, and withdrew the dog-eared copy of his latest unpublished manuscript that I had read and marked up. I approached him with a pen, and asked for his signature. He paused before he took the manuscript and my pen, but immediately sat down at a nearby table, and signed his name simply but with penmanship that was magnificent. (see the picture)


His handwriting was remarkable for a man of his age, and I said something tacky like: “Mr. Deming, your penmanship is as sound and smooth as your management theories.” He looked down, paused, then said, “You know, I, ah -- could probably answer your questions a lot better than I did.”

It was one of those moments I hope I never forget. He sat back down, we wired him again for sound, and I conducted a solid 45-minute interview that made our project a huge success within Ford Motor Company.

It’s Up to Management to Fix It

That story has a moral, as you might expect—When something is wrong with the system, it’s up to management to fix it. That is also one of Deming’s themes—“The problem is at the top: the system can only be fixed by management.”

In our interview, I was the manager. I knew it was my responsibility to fix the problem, but I really didn’t know how to do it. By asking Deming for his signature on his manuscript I unwittingly demonstrated to him that I was not the regular journalist hack who had not done my homework. When he realized that I knew what he was all about, and that I deeply appreciated him, the problem was fixed. It was a lesson right out of his book.

The heart of his quality management theories is this: If you want a good product to emanate from your system, management has to continually test the system and make adjustments. If you don’t you’ll turn out bad parts as often as you turn out good ones.

Catechism Instruction

That is a concept that has everything to do with catechism instruction.

There has been enough written about the pathetic situation of Catholic faith formation and how poorly children, teens, and adults are formed in their faith, that I will not review it here. The analogy in Catholicism that parallels American industry from the 1950s to the 1990s, is that we’re turning out bad “parts” that don’t work well. That is, the products of Catholic faith formation have not generally met the requirements of being a Christian capable of defending or living their faith in the face of a belligerent society.

Taking a lesson from Deming, and applying it to religious instruction, let us review. There are four levels of instructional testing that can be administered. So far, I’ve written about one of those in an article that deals with the importance of a Level 1 Evaluation. I also provided a form catechism instructors can use when conducting that bit of research – see my Best Practices in Faith Formation web page HERE and the link titled: “CLASS SESSION EVALUATION: A Level 1 Form."

In my mind, the Level 1 Evaluation is the first test that every faith formation instructor and developer should be administering, nearly every class time. It is a test that evaluates the instructors, the course designers, the coordinators, and parents or spouses—those individuals that orchestrate the learning process and environment—Deming’s management. The Level 1 evaluates the instruction in an “affective” way. That is, it measures the instruction’s ability to engage and motivate students.

The Level 2 Evaluation

Just as important, is the Level 2 Evaluation, which tests the student's cognitive understanding of course content. In regular school courses the tests students take for their report cards are Level 2 Evaluations. Except, that in an instructional design sense, the test is as much an evaluation of how well the instructional design, the instruction itself, the instructor and the parents/spouses do -- as much as how well the student does. This gets back to the onus for good instruction falling on management, although it does not remove responsibility from the students.

So, at Mass this morning, Fr. John Riccardo (Our Lady of Good Counsel parish in Plymouth, MI) delivered a homily that I almost interrupted with cheers and cartwheels. (I didn't, for which he is thankful. But my angel was urging me on). Here is what he said, via an email he sent me later in the day at my request.
Several weeks ago I had the chance to go into our school and teach our 7th and 8th graders for four days in a row. It was supposed to be a sort of introduction to the Theology of the Body, but it really turned into a basic understanding, rooted in several key Scriptural texts, of who God is, who we are, why He made us, and how to find happiness. At one point, on the last day, I went into a quick overview of the Ten Commandments, and at least as importantly, the context of when these ten gifts were given. It was at that point that I told the 8th graders that in order to graduate this year they would need to know the Ten Commandments. Since then, I have also made it clear that all the 8th graders need to know the Ten Commandments in order to be confirmed.

Now, a bit surprising to me, this has caused no small stir, and not merely among our students, but even among our catechists and among parents. For whatever reason, in religious education, we've gotten out of the habit of demanding that kids memorize anything, even though in every other discipline, whether it's football, dance, cheerleading, math, or science, coaches and teachers make absolutely no bones about demanding that their students and players memorize things. In fact, because we often don't demand that our kids memorize anything in religious education, we give the impression that this isn't really that important. Where we demand little, little is understood to be of significance.

But I don't want kids to memorize simply for the sake of memorizing. There is great value in learning the context of the Ten Commandments. This is one of the greatest dramas revealed in the Old Testament, and in helping the kids learn the context of when God gave these, we help to shatter the mistaken and distorted image of God that is so rampant in our culture: that God is some sort of 'celestial kill joy.' In reality, the God who gave the Ten Commandments is a God who liberates and saves. If He had wanted to enslave us somehow, He would have left us in slavery in Egypt, where the Israelites had been for more than 400 years. But He wants life for us! And the God who rescued us out of slavery is the God who gave these Ten Gifts so that we could find happiness. [Stan notes: King David wrote about how he loved God's law. David understood that by obeying those laws, he was led into a life of happiness, contentment and joy.]

Jesus says in the Gospel today, "This is the verdict: the Light has come into the world but men preferred darkness to light." (John 3:16-21) My experience with the kids and the discussion of the Ten Commandments comes to mind this morning because many of our kids think that darkness is light and light is darkness. They have been inundated by a culture that calls good "evil" and evil "good," and so they are confused. And it is up to us as parents and educators to help them understand that God is a God of life and that He has laid out for us the way that leads to life, and warned us of the way that leads to death -- no matter how enticing it may appear.
Accountability

And the way for us to approach the light that both faith and reason require of us, to be happy, is to be ACCOUNTABLE and RESPONSIBLE for what it is we are supposed to KNOW. To require that students (whether children, youth, or adults) for TEMPORAL REASONS memorize, understand, demonstrate, and provide feedback successfully through a variety of mental and physical tests in order to graduate from one grade to the next, and not to require the same testing for ETERNAL REASONS , is irrational, irresponsible, and demeans and scandalizes the importance that supposedly the things of God are supposed to be in our life.

We should not have to think about this for more than a moment. Level 2 Evaluations (and even Level 3 and 4 that measure how implicitly the values of Christian living get into our life) should be the demand of every bishop, every priest, every DRE or FFD, and every religious education instructor throughout Christianity. It is not a grace to pass (and/or confirm) everyone that shows up. It is a scandal to confirm students that go through the motions but do not understand because of their lazy attitude, or more seriously because of their ambivalence. Apologist and author Dave Armstrong writes, “It is no less sensible to demand appropriate religious knowledge than for anything else. To not do this presupposes that religious matters are somehow only “private” or unimportant, or optional, or separated from the mind and common sense.”

If you are scandalized, according to a report that came out this week, that few are graduating from high school these days without dropping out or extended delays, (only 24.9% in nearby Detroit), then what would you think if only that percentage could pass an examination of faith (both cognitive and attitudinal) after years or months of religious education? We need to change this ASAP.

So, what are you doing, or what have you experienced? Let’s hear from you. Fill up the comments below. We need to compile some “best practice” illustrations of how Level 2 evaluations can be applied to revitalize Catholic catechesis.

14 comments:

  1. Excellent post! My background is in Management Development (M.A. in Industrial / Organizational Psychology), and I used to conduct Levels 1 - 4 assessments of training programs all the time in my corporate job. Now, I administer a lot of Level 2's for my four homeschooled children! :-) (And some Level 3's, more or less, as well!)

    And I, too, wanted to cheer about the homily. Yes, we must memorize the faith, or we end up walking around with heads full of vague generalities and mush. For my kids, that includes the 10 Commandments, the names of the Books of the Bible, the Four Marks of the Church, the Four Evangelists, the 12 Apostles, etc. etc. It's so important!

    ReplyDelete
  2. Thank you for making connections I have also believed were relevant.

    I have been a fan of Mr. Deming's since I read his book, Out of the Crisis, in 1997.

    I have not finished reading your article as I have to head off to work, but will come back to it later and finish.

    I look forward to more posts like this!

    ReplyDelete
  3. I just read you r article on the opening page of Catholic Exchange. Fantastic! Our older children had been in public schools and we tried the religious education at the local parish. It really was a waste of time. W didn't want them to suffer the same fate that we suffered by a lack of catechesis. At that point, we used the faith in Life series at home to instruct them in the faith. I would tape all sorts of bits of information on the kitchen walls to assist them in their knowledge of the faith. This past year, we removed our two younger daughters from the Catholic Diocesan school. The religious education was really poor. They are now enrolled in the Seton Home Study. I was amazed at the expectations for religion...a text/workbook, the Baltimore Catechism, and a Bible history book. At first, I thought it would be too much for the girls to memorize. It's truly wonderful to see how easy children can memorize facts if we expect them to. I think we definitely need to raise the bar. Even in the Catholic High Schools we find our children know a great deal more about the Catholic Faith than their teachers. It just goes to show you that the Church is right on when she states that parents are the first and primary educators of the faith. I recommend purchasing these catechetical materials and teaching your own children. They can be purchased online. We are learning a lot by teaching them the basic truths of our faith. We all need to be reminded. It is true that the faith is more than a set of memorized facts. Pope Benedict XI told us that it is more than a set of rules, but rather a relationship with One we love. But, we still need to know what that One wants us to do with our lives. Thank you for the excellent article. It was encouraging.

    ReplyDelete
  4. I just read you article and could not believe the timing of it. I am a Director of Religious Education and our Confirmation Program requires our students be tested in order for them to move forward. We have a two year program: Year I is mostly 8th graders and Year II is mostly 9th graders. Our curriculum covers the first two pillars of the Catechism in Year I (Creed and Sacraments) and the second year covers the 3th and 4th pillars (Morality and prayer). Last week was test day. We had prepared the studnets all year for this by giving them the test at the beginning of the year and over Christmas Break (take home). The end of the year is where they receive an actual grade for their performance. Our requirement is that they score a 70% or better to show they are ready to move forward. In fact in our Year II Confirmation class we gave all 37 students the answers to the test 4 weeks ahead of time to set them up for success on test day. The test is approxamately 91 questions with about 15 to 20 extra credit questions. Unfortunately only 13 of our 37 Year II students passed it and 12 out of 39 students passed it in Year I.

    One of the frustrations I'm having this week is that parents are meeting with our pastor for an "exit interview" before Confirmation. The test has become a major discussion point in the meetings. After Confirmation classes last night my catechists shared how many of the students are not appreciative that we looked at their regular Sunday Mass attendance, class attendance all year and the required service hours performed as the other components that determined their readiness for Confirmation instead of the test alone. My pastor and I thought it would not be totally fair to see so many fail the test and to defer the Sacrament of Confirmation because of the test. Yes, we could have, but we chose to discuss with the students and parents how if they do not know their faith they are in danger of losing it. Some kids and parents are upset because of the fact that we even considered holding students back because of a "test grade" and some parents believe that the test was too hard and it should not have been expected that their child get a 70% or better on it (even though they knew about it all year and had the answers 4 weeks in advance). It has been a tough year trying to communicate with parents and students how important it is that we know our faith and live our faith. They are connected and not separate from each other. I hope these comments helps give some practical application the the article written.

    ReplyDelete
  5. What still disturbs me, and I'm experiencing it right now, is that as important as I think this Level 2 testing is (and I did write the article with some level of passion), "head" knowledge isn't enough. It has to get into the heart and be lived. I know Catholics who can pass the Level 2 written test, but fail it when we get to Level 3 and 4. More on those levels next time. Pray, fast, your salvation and that of others is at stake.

    ReplyDelete
  6. The goal is to produce Catholics who know their faith and live it. A personal relationship with Jesus is the end goal, but what would a relationship be without actually knowing the person with whom you supposedly have a relationship?

    The key in my opinion is to be able to administer a test to gauge the effectiveness of the classroom based training, while not making the Confirmation Sacrament seem like a reward for a job well done. Or as it is commonly seen today, as a graduation from RE.

    The parents have the best opportunity to pass on the faith to their children, not the RE program. As you say, there are folks who can memorize lots of stuff, but not actually have a full understanding of what they memorized. The case of St. Bernadette is a prime example of a person who could not perform well in school, but absolutely loved the Lord and his Church. What do you do with a person like this who really desires closer union with God, but cannot grasp the deeper concepts of the faith or memorize all the prayers. This could prevent those who are mentally deficient of encountering God sacramentally.

    I say make sure you educate the parents, and enable them to educate their children and pass on the faith!

    God Bless,

    ReplyDelete
  7. I understand the concept of this article and the need for evaluation of catechetical programs. But since this article is focused on Confirmation preparation, it brings up another question. We, parishes/catechists, often present Confirmation as a "next level" sacrament and that it should be contingent on meeting certain requirements. But I also know that the sacraments are channels of God’s free gift to us, his grace, and are dependent upon us only in that we cooperate with that grace and give assent, either ourselves or our parents for us. The Eastern Rite Catholic churches and the Orthdox churches confer the three sacraments of initiation at one time no matter the age, even as infants (thus not requiring any knowledge of the faith on the part of the infant). (See Catechism 1306-1308).

    From my experience as a Confirmation teacher, preparation requirements for Confirmation (and other sacraments) have been used as an effort to keep children somehow connected and minimally catechized when otherwise they would be receiving nothing at their parishes or from their families, whether because the parish doesn't offer anything or the parents do not think catechism is important (probably because they never had it) and only show up for sacraments. Then we never see the children again until such time as they may return on their own as adults.

    For parents, unfortunatley many of them have never been cathechized and many parishes do not offer anything for them either, so the cycle continues. So we come back to the same problem – poor or no catechesis to even evaluate.

    ReplyDelete
  8. We are a homeschool family who once sent our children to CCD ( PSR) classes (no longer). I have been a 2nd grade catechist for 8 + years and tried to make so many changes in our parish to improve the "curriculum" both with the children and the parents. It wasn't easy and it didn't last. The parish felt that they needed the expensive packaged curriculums where I was working with the Baltimore Catechism and other easy less expensive books. More understandable for the children and the parents. I also involved the parents in the classes I taught for First Communion and many enjoyed being with their child and learning with them. I understand this article was about Confiramtion requirements, but I truly feel you need to begin at the foundation...the classes offered for the littlest ones, should include the parents, either one or both! Should continue throughout the Elementary years with a parent being present at the classes. We need to get rid of the "feel good about me " activities the elementary curriculums have get back to the basics of the faith. Kids will live for an hour class without a craft or a snack!
    My Middle school son attend the EDGE program at our parish last year and hated every minute of being there...his reason?...He wasn't being taught anything! At 12 years old he didn't want to attend EDGE because he said it was a waste of his time. The kids were rude and teh teachers couldn't control them. They were lucky if they learned 1 thing each month about the church or the sacraments.
    We decided to teach everything now at home and we no longer attend the CCD/EDGE/LifeTEEN groups at our parish.
    For my own children,
    we use the Baltimore Catechism for many years to cover doctrine. We use Faith and Life texts for middle school grades. For high school we use the Fr. Laux books: Chief Truths of the Faith and Catholic Morality, Mass and the Sacraments, Catholic Apologetics, Introduction to the Bible, and then Anne Carroll's Following Christ in the World. (This last text we use in 12th grade due to mature materials discussed). We also try to do other things as a family to live our faith ( which we hope our children will carry on into their adulthood). We have the privilage to attend daily Mass, we pray for and support the Seminarians of our Archdiocese ( getting to know almost everyone of them), we attend as many Ordinations as we possibly can, and our family tries to be as active in our parish as we possibly can.
    We recently attended a Confirmation at a parish in Gainesville, FL. It was very large with 60+ Confirmandi. OUr family was very sad and disappointed with how these Teens seemed so unprepared and also how they were so disrespectful. The Mass was a huge "Production", all the kids in Tux's and evening gowns, solo music performances, etc..etc.. My children wondered, "What happened to the MASS?"

    We must all pray and work hard to make changes for our children and the future of our church!

    ReplyDelete
  9. Excellent article!
    My experience is similar to many of the above - I am simply a catechist, not in management. I have a system for teaching that seems to work for me, but because of poor parent support and pastoral support I don't know if it makes any difference in my students' lives. I usually start off with reading a chapter of the Faith and Life book for the appropriate grade, then I like to include a telling of the story of the life of a saint (for inspiration and example), then we usually play a game, like "Credo" (see Faith and Life teachers guide. I make up my own Credo cards ahead of time and I have several sets - a basic catechism version, a saints version a Confirmation version, and a Virtues version.) By the end of a few rounds of Credo, most of the class know most of the answers.
    However, then Confirmation comes around. The Bishop only comes every third year, so most of our students are confirmed by the parish priest. Then, the music at the mass is absolutely unspectacular (Circle of Friends, Children of the Light, etc.) and its very easy to see what will become of the children's year of catechism.
    I'm complaining too much, perhaps, but it's a bit exasperating.

    ReplyDelete
  10. Stan,
    Thank you! If I would have had your article several years ago when I was writing my thesis on religious education vs. faith formation, it would have been the icing on the cake! As a youth minister for many years, I have experienced 2 things that "make" or "break" a program. The most important piece is the families of the students involved. If they do not "buy" into the program, then there isn't much you can do. But, if you CAN get them to come to sessions themselves (concurrently running sessions work wonderfully for this), the success of the program goes up exponentially.

    The second piece that determines the success of the program is the support of the pastor. The pastor has to be willing to stand by the program and the director of the program when parents whine about time constraints etc.

    4 years ago, we were faced with the choice of moving our children into a parish school about 25 minutes from our home or home school all of them after a bullying session at the public school. After viewing the materials from both programs, we opted to homeschool. Now, my children (including my kindergartener) are "teaching" their peers at church events including VBS. The difference between the programs? We use the catechism and my children memorize the catechism questions/answers starting in 1st grade. AND not only do they learn it, but I am learning it myself. After going through a Catholic University and receiving a Masters Degree in youth ministry, I am learning more myself through the catechism questions/answers than I did from some of my college level theology classes.

    Again, thank you for saying what so many of us feel but have no means for voicing!

    ReplyDelete
  11. I'm jealous that you had a chance to meet Dr. Deming. My father took his famous 4-day class at General Motors in the 1980's.

    Your comment "Today, Deming’s measurement and testing techniques are the backbone of American industry."

    Unfortunately, that really couldn't be further from the truth. Dr. Deming's message has been lost, for the most part. Companies are still run under the same old management practices that Dr. Deming always railed against.

    His philosophy "should" be the backbone of American industry, but it's not.

    He *was* incredibly influential to Toyota and that comes across in the books about Toyota's management system. Look at Toyota's success today compared to Ford's and GM's...

    Very interesting post, even to a non-Catholic who is just married to one (I'm Eastern Orthodox).

    ReplyDelete
  12. I developed a bookcover that had the ten commandments, the mysteries of the rosary, the virtues for each mystery, the corporal and spiritual works of mercy, the beatitudes, the morning offering and the prayer the angel taught the three children at Fatima.

    The bookcover went on all the books in the grade school. Then when the books went home with the child and homework was done -- guess what--the parents read the outside of the bookcover. I also thought if the child was daydreaming in class and they had a bookcover on their book they might read the bookcover rather than day dream. It takes 15 exposures to a fact before one will remember it. The goal was to expose the child to what we wanted them to learn at least 15 times.

    To pray the rosary better I developed a rosary DVD which has 200 scriptural phrases and 200 images. You can see it at www.Scripturerosary.com. It teaches the scriptures with pictures and teaches the virtues for each mystery.

    ReplyDelete
  13. A wonderful post and interesting comments...much to think about.

    To that list of best faith formation practices I would add regular holy hours of Eucharistic Adoration. Along the lines of the commenter who said,"getting to know" Jesus...nothing compares to that time in silence with Our Lord. What ever happened to silence? We only hear Our Lord in silence. Our teens are being trained to fill up their lives with noise.

    Another concern, also touched on in comments, is what Steven Kellmeyer (Designed to Fail) has written on as well. Parents need to be catechized and our churches should be focusing on that.

    ReplyDelete
  14. I agree with +JMJ+ about catechizing the parents. Family involvement is a crucial element!

    My 2nd graders have supplemental lessons to complete at home for First Recon & First Eucharist. Those at-home lessons make all the difference, because the parents become catechists (at least for those lessons)! And as we teach, we learn!

    Our DRE *wishes* we could require supplemental lessons for the other grade levels - I think we could and should. I'm going to talk to her more, and our pastor.

    ReplyDelete