Monday, January 26, 2009

Update on Our New Open Science Activities

I think it's been about a month since I started these blogs and joined friendfeed. It's been a whirlwind, really. I've e-met dozens of scientists around the globe in that short time, most of them much farther along than I and my lab are in terms of open science. The community of scientists out "here" is incredibly welcoming and helpful, and I want to send a thank you out to whomever of you read this post.

It's also been a time of huge change in terms of our lab's open science activities. We have started a lot of new open activities, and I thought I would make a list of them here. I'll only list those things that are new since mid-December, and I think it's quite a lot.

Blogging

Of course, I started blogging. We also started a blog that I and our lab members to contribute to. So far, only Anthony and I have contributed to it, but that will evolve over the year, I think. So far for me, blogging is a treat and I've been able to rationalize doing it based on potential synergies with the activities I'm supposed to be doing :)

Posting grants in public


We started posting our grants on Scribd. I chose this site from advice from Jean-Claude Bradley and Cameron Neylon. So far, I've liked the site as a place for sharing grants and other documents and it seems to work well. As an example, here is the grant we submitted last week. Posting grants has been really helpful so far and I expect it to continue to be helpful. We've received helpful comments from a couple people, and also made some science connections because of it. For example, Cameron and I realized we have a lot of science interests in common!

Paper preprint

A big step we took is we drafted our first paper out of our lab and we posted it on Nature Precedings. Larry Herskowitz is the lead author on this paper. We posted it a week ago, and we immediately received very helpful comments, questions, and suggestions from Richard Yeh. We're using OpenWetWare to talk about the paper with Richard and any others who want to join. My opinion right now is that OpenWetWare is a better place for these kinds of detailed lists of questions and suggestions, because we'll easily be able to break it into different topics, create sub-pages, and post supporting data, figures, etc. (In contrast, we found that trying to write the paper on a wiki just did not work for us at all.)

Open research projects

We have also taken some big steps towards "open notebook science" in the past month. We've been using a private wiki for about two years now, hosted by OpenWetWare. As I understand it, providing us with a private wiki was part of an experiment to see if it could draw in more users and lead them towards open science. You can't scientifically extrapolate from our experience, but then again, you don't have to approach it scientifically...so, my opinion is that providing the private wiki worked out beautifully for OWW's mission. I think they should continue to provide private wikis, including for select new users on a trial basis. It's quite possible (impossible to prove, though) that none of the open science activities I'm describing in this post would have been started had not Jason Kelly offered me the private wiki two years ago. Thank you Jason & all the OWW founders! I'd also like to thank Bill Flanagan who has helped me tremendously in many areas of the public and private wikis.

Having prepared via our "warmup time" with the private wiki, many of the students in my lab have begun to take open notebook steps in the past few weeks. You can find links to these on our open-research projects section. Anthony Salvagno has started doing real open-notebook science, keeping his daily notes on OWW, using the Lab Notebook system that Ricardo and others developed. Anthony is about to start learning molecular biology in our collaborator's lab, with guidance from Kelly Trujillo. The lab is not accustomed to e-notebooks, so it's going to be really tough for Anthony to not be driven to use a paper notebook. We'll see how it goes, I'm hoping he can show them the way!

Caleb Morse is embarking on some MediaWiki projects and we're trying to do our communication via OWW. There are many interesting things he might pursue this semester, many of them improvements to OWW and / or MediaWiki that can make the conduction of open research much easier. For example, he's currently working on modifying an extension to MW that uses cookies to prevent data loss when the browser crashes or closes while editing a page. This would be a huge plus for OWW.

Finally, Andy Maloney joined our lab in October and has learned to use the wiki very quickly. He recently took his first leap into the public wiki by posting his incredible instructions on how to build a laser diode control system from OEM parts. I'm also pushing him to post some of his earlier research accomplishments on OWW, including a custom microscope he built for imaging ultrasonic fields via the sonoluminescence. His Google SketchUp drawings and fly-by animations of the thing are amazing and I want you all to see them!

Open teaching

I've also started posting teaching material on Scribd. I'm trying to be careful about copyrighted material, so I'm not sure whether I can keep that up. One of the things I try to do after lecturing is to "debrief" to help with next year's lecture. So, combining blogging with Scribd is a good way to do that.

Back Pat

Looking back over that list of new things we started doing only recently has made me feel great about our lab. Obviously that rate of science "opening" can't continue. But I really do think we'll be able to keep up most of the things we've started, and I'm excited about that. On our private wiki, use a template that Anthony wrote for giving yourself a pat on the back. You just add {{BP}} to a page to use the template, and then you get an electronic pat on the back and feel good about yourself. Or at least some of use do. So, I'm going to put {{BP}} on this article and it's for me and all the students in our lab for these accomplishments. It's also a {{BP}} for all of the scientists I've been talking to recently and who have helped us take all these steps. They've provided very valuable advice and examples about how to do it, as well as encouragement and feedback for the steps we've taken. Thank you!

Friday, January 16, 2009

Talents in the Lab

So, I just got back from a vacation--no internet access for a week! Ugh--I think some people find getting away from it all rejuvenating, but that is not me at all. In fact, this would be a complete non-talent for me. "Non-talent" is terminology from a book that I re-read while on vacation: "First Break All the Rules..." by Buckingham and Coffman. I first read this book several years ago, when I was immersed in the misery of being mismanaged. The concepts in this book are not complicated and to me even seem obvious (now that I've thought about them), but it still seems to be true that most managers ignore these concepts. Re-reading the book last week was even more illuminating, now that I've had a couple years of being a manager myself and can reflect on my own strengths and weaknesses as a lab manager and plan small changes that may have a big effect on outcomes for our students and the science we're doing.

One of my talents is the ability to read these kinds of management and leadership books without getting too hung up on the fact that they're not perfect science. Though, I do like this one especially because it is founded in a whole bunch of research (the authors are out of Gallup Consulting) and objective analysis. Via hundreds of thousands of interviews with employees and managers across all types of industries they tried to determine common qualities of managers whose groups far outperform the others. Thus, they tried to find out what great managers do differently than good and bad managers. The main points they found out ring very true for me, and really, THE main point is that great managers recognize the following things:

  • By the time people are grownups, their brains have been "wired" in unique ways because of their genetics and their experiences growing up. These genetics and experiences produce a set of talents and "non-talents" for any individual. The authors refer to this as the unique "filter" each individual uses for their everyday experiences. The key point is that these talents are not teachable to grownups and great managers recognize this. Skills and knowledge contrast with talents, in that they are teachable. Learning skills and knowledge is easy for someone with underlying talent in that area. Learning skills and knowledge without the underlying talent is a constant uphill battle.
  • In order to succeed and be happy in a particular job, a person needs certain talents. Great managers figure out what those talents are, and try to assess those talents when hiring people. Contrast this with the system most of us are familiar with, where people are assessed based on resumes and interviews which focus on skills and knowledge. Determining what talents a job requires is not easy. It's even more difficult for a manager to assess someone's talents. And possibly, for many people, the most difficult thing is for an individual to assess their own personal talents--I know it is very difficult for me.
  • A great manager spends time helping his people discover their own talents and helps them make career decisions based on those talents.

I think while reading this book in graduate school was the first time I'd consciously considered talents existing for things besides athletics, music, acting. I think I easily accepted, for example, that professional musicians had innate "hard-wired" abilities that enabled them to enjoy the hard work it took them to achieve that kind of excellence. I knew I didn't have those talents and didn't entertain any notion that I could just "work really hard" to become a professional musician or athlete. But I don't think I ever considered the vast array of other ways people could be talented, or non-talented, and I think I was probably a subscriber to the popular notion that I could succeed at any kind of job I landed just by forcing myself to work hard. And if I was failing it was my own fault for not working hard or smartly.

While considering that last paragraph, I think it's not quite correct. Back then, I probably did recognize the existence of many talents, but I had not sensibly defined them. For example, I may have thought I had a "talent for science," since from 1st grade through graduate school I had received good grades and succeeded in science "things." Therefore, I would have deduced that I have a talent for any kind of career related to science: graduate student, professor, R&D, science writer, elementary school science teacher, science policy advisor, etc. In fact, I think I entertained the notion of all of those careers at some point. I probably made the reasonable step of considering whether I'd like those careers, but I did not even come close to considering that it was my own talents and non-talents that would determine whether those careers would be thrilling or miserable.

Ever since reading that book, I've been wondering about my own talents. Ironically, I'm untalented at discovering my own talents. I suppose some people are very talented in this. When I preach to my students about this topic, I'm often asked, "What are your talents?" I know that I have many talents, and some I know specifically. For example, I know that I absolutely love computer programming. I can work on data analysis applications for 16 hours straight days at a time and love it. This is a talent for me, and considering that I was spending 10 hours a day in 3rd grade playing around with BASIC on my Commodore 64 this is not a surprising talent. But it's one I don't get to use very much any more, due to my career choice. I also know that I have a lot of non-talents. I think it's just as important to discover these, and for me these are easier to find. I'm still not quite sure what it's called, but I have at least one non-talent that would be required for easy writing of scientific papers and grant applications. In contrast, I find these blogs fun and fairly easy to spew out--I enjoy this kind of writing, and I probably have some kind of talent that is being used by blogging. But there is something about the precision or brevity or efficiency or whatever about formal papers and in particular grant writing that give me serious writer's block. I have been writing grants for two years now and it is always unpleasant and very difficult. I feel like I produce good documents, but it is very far from easy.

That last point is the key: it's not easy. (And I don't enjoy most parts of it.) This is a great way of discovering talents. In the book, they cite a manager (anonymously, unfortunately) who developed the "Sunday Night Blues Test." He asked his employees to stop and think on a Sunday night whether they were happy the weekend was over, or whether they were a little depressed. (Assuming a five day work week.) The employees then were to consider what specific things they had planned to do the next day. Their level of happiness / unhappiness about their activities the next day would be a way of understanding what talents or non-talents they possessed. I like this test, and it's helped me quite a bit in assessing myself.

I've used a variation of the test in the courses I've taught, in the hopes that my students will learn something about themselves far earlier than I ever did. On the last day of class in the four semesters I've taught, I've presented them this last un-graded homework assignment. You can view it on this openwetware page. I ask them to reflect back on the semester that's ended and to ask themselves which courses they're most sad are ending and which they are elated to be done with. I ask them to think about specific assignments that were fun or others that were dreaded. I don't have any kind of evidence, but I feel like there's enough variety of things students are asked to do that they may be able to discover talents and non-talents this way. A few of my students "turn in" this assignment via email or WebCT, and I always find it fascinating and pleasurable to read what they have to say. Usually these are students that I've come to know a bit, so I can give them a little feedback on it too, which I enjoy. (This probably indicates a talent I have for getting true pleasure out of students' successes.)

I realize this blog is getting long. I think I did say above that brevity is a non-talent of mine. I'm considering breaking this into two posts, but instead, I think I'm going to leave it as one post glued together by this added paragraph.

So, as I mentioned above, I re-read this book a couple weeks ago, and I must have marked up every other page and wrote down several dozen ideas it gave me for how to better teach, manage our lab, and be a better person. One of those ideas which I've followed through on is to work on identifying talents of the students in our lab. I have a few reasons for wanting to do this. The most important reason is that I want to maximize the success of every student that comes through our lab. I really believe that the more they can understand about themselves and their talents, the happier and more successful they will be in their next career step. The next reason is that I can manage the lab much more effectively if I know what talents and non-talents my students have. I'm not sure I have the talent to do this, but I am sure that it can't hurt for me to know more.

Believe it or not, I actually had a "talents" meeting with all three of my graduate students this week...between 2 and 3 hours with each person. I even went so far as to use the interviewing questions from the book. This was really cheesy, but my students trust me enough to have followed through honestly with the process. The questions are designed to reveal talents. I left the book in my office, so I can't quote any of them directly now, but some of the questions I found most revealing were:

  • What keeps you working here? (in the lab)
  • What is the best kind of praise you have ever received? What made it so good?
  • What is a productive partnership or mentorship you've had? Why did it work so well?
  • What are your current goals and what is your timeline for achieving them?
  • How often do you want to meet with me to discuss your progress?

All the questions are good, but those are coming to mind now as having elicited responses that pointed towards talents or non-talents.

I don't want to get into any specific results here, because my students and I didn't really discuss yet whether this process would be open or not. Actually, what I'm hoping is that through this continuing dialog, it will become a habit of our lab to point out to each other obvious talents and even non-talents. I think we have a lot of respect and trust in each other, so it's likely we can achieve this kind of productive openness. In any case, without being too specific, I can tell you that I was really surprised at how much I learned from these meetings. Even considering that I already expected them to be productive meetings. Again, I think I am lucky to have very good and trusting students, so our dialog was very open. In addition to the questions from the book, I also asked each student to talk about their most productive time(s) in the lab so far. (Another variation on the Sunday Night Blues Test.) I found this incredibly useful.

One of the most humorous, surprising, and potentially useful result was what I learned about the students' and my own talent for competitiveness. If someone has this talent, they are driven to compete and win against other people. A different kind of talent is a need for achievement. This is different, because it is not relative to other people, but an internal measuring stick and a desire to constantly improve. It turns out I and one of my students have a strong competitiveness quality. This didn't surprise me too much. What did surprise me was that the other students did not have this quality. One common flaw of managers is to follow the golden rule of treating others the way you'd like to be treated. I have this flaw too. Up until this week, I think I'd pretty much assumed that everyone was competitive. But what I discovered is that's completely not true. I had also down-played my own competitiveness, and I now realize it's an important part of me and my motivations. So, what can I do with this information? I'm not sure, but given how surprising some of it was, I don't see how it can make me a worse manager. Just a simple example is that if you try to motivate an achiever and a competitor by having them compete against each other it's not going to work well. I don't think I've tried do that, but as a manager I'm always doing something , whether or not I'm trying to.

I'm going to try to wrap up this wandering post now. If you have a talent for reading management or self-help books, I strongly recommend you read the book I've linked above, "First Break All the Rules." If you don't have that talent, I do recommend trying out different ways of discovering your own talents. During the few weeks I've been on FriendFeed, I've already seen a few people making or considering career moves. I think talents are the number one thing that will determine whether these moves produce success and happiness. A perfect example is the ineffective way in which university faculty are chosen. Successful graduate students and postdocs are evaluated for professorships based upon their achievements, skills, and knowledge as researchers in the lab. The job, however, is not at all similar. I am now a manager, teacher, grant-writer, leader, and I don't know what else...but I'm not doing research in the lab very often if at all. In light of the selection process (and the utter lack of training), it's not surprising that there is so much struggle seen in this career path. Luckily, I think I do have enough of the talents required for my job, and I can ultimately succeed.
 
Creative Commons License
This work is licensed under a Creative Commons Attribution-Share Alike 3.0 Unported License.