Facebook and data..

This is a post on Facebook data.. my Facebook friend list data..

Given I tell FB a lot, it was quite interesting to see how FB doesn't make it easy for me to even track what is going on with my Friend list and update me on what is changing. 

A few hours ago, I was trying to see how many of my friends post politial stuff on my feed. I could count 8 people off the top of my head and by skimming my feed over last week. Given it is holiday season, it is easy to spot the political posts.. My count was accurate. My entire feed is pretty much overwhelmed by these 8 people. Maybe the others dont post much? Maybe the most vocal ones are the ones that keep forwarding stuff to everyone on their timeline? Maybe the things they are forwarding are paid ads masquerading as meme's or just regular forwards? Maybe the people are not who they claim to be on FB and the account is hijacked? a lot of thoughts led me to try and find out again how after reducing my friend list to 150 two years ago, it is back at 318 now.. what has changed in the friend mix etc. etc.

Any analysis starts with the data set. Trying to export just the list of friends and the number of friends they have (or mutual friends) is not trivial. I did spend a lot of time copy pasting stuff from HTML to csv to JMP and had to do some clean up just to get the data in three Columns.. (Friends name, their friends total, mutual friends). Now why FB lists only Mutual friends in some cases I do not know. At first glance it looks like some folks do NOT want to even disclose how many friends they have!! I don't know what the point is of being on a social network if you are that worried. Let's move on..

Then I found that some of my friends have deactivated their accounts. Their pictures are blank and there was nothing listed. When I click on that friends page it says "this account is deactivated. you have the option to unfriend this person". WTH? This was for multiple people. So the person just left FB without a note of any kind to say they are deactivating it? 

72 of my friends show only a mutual friend count. So it makes it difficult to do a fair distribution.. that was a painful realization that there was no way to get the friend count. You have to go to that friends page and see if it will show up. Even my wife's page will only show we have 152 mutual friends. It wont tell me how many friends she has in total. Not that this count matters but if you are looking at data and you try to see patterns it makes sense to have apples to apples. 

Then I put in a classification by how they are my friends. 

F- Family (anyone related by blood or marriage)

HS- high school (PS. Senior)

C- college (classmates, juniors, seniors) from IT-BHU

GS - Grad school (All the Drexel and RPI connections)

FF- Family friends (this one is tricky because some of these people we met in social settings, my kids classmates, but Majority are spouses of friends from HS, C, GS or my wifes classmates and their spouses)

BL- friends from my Blogger days who I have managed to stay in touch with till now!

Y- Yoga (there are teachers and there are students, but I just lumped it into one)

W- Friends I made at Cypress Semi at work

Here are the distributions given this classification:

This one is the distribution of the friends my friends have (unfortunately for the 72 people out of 318 where it listed only mutual friends, that data is not included in this). 

If you read the anthropology books Guns Germs and Steel or Sapiens, the authors make a case that tribes split up into rival tribes or multiple tribes after their populations cross 140-150. The social structure at that point is unmanageable and the connections become meaningless. At any one point everyone closely interacts with 15 people on a day to day basis. In the last 2 years I have observed this at work, at home, at gatherings and on my social media feeds. People simply become inactive.

Given that there are some celebrities in my FB friend list (read star Yoga teachers, music teachers, public figures) I took them out of the distribution to see what it looks like for the bottom two bars in the previous graph.. ie, people with under 1000 friends.. The people who are between 600 and 1000 are mostly inactive but keep accepting friend requests and looking at some of their pages, I am seriously wondering if there are account issues. Again, companies that pride themselves on AI should be able to see patterns and alert people that one of their friends is multiplying on their friend count in an abnormal fashion that does not make sense.

117/212 still have <300 friends.. and 78/212 are within 200.. Gave this 150 number a lot of thought for the "average person".. read "not someone who is trying to get a following like a Business person or Brand ambassador)  and maybe given todays ability to connect more easily, that number can be 300.. It should be able to plot the number of active interactions between me and my friends to verify this. I am sure FB does this or has the capability to do this, but it would be nice for me to do it with data at least as it relates to my account and friends.

In the graph above the top four points on the Family (F) are wife, MIL, SIL and co-sister (see graph below) why it will only give the number of mutual friends for these four people is beyond me.  You can see that a lot of my High school and college friends are connected to each other by looking at the mutual friend count and it is the case with the Yoga community. I really don't have an apples to apples on this one as technically all the mutual friend counts are not available.

The graph below is the mutual friend list distribution where FB wont list their total friends but only mutual. Each bar is the number of friends who have a mutual friend list between those windows.. eg. 1 friend (wife) with 150-160 mutual friends, 1 with 50-60 (MIL), 2 friends with 40-50 mutual connections (SIL, co-sister), etc. etc.

The bottom 32 people with 0-10 mutual friends are mostly not sharing their friend list?

So what did I learn from all these exercises of graphing and charting and cleaning up data sets?

1- It is not easy to get exportable data out of Facebook.

2- There is no notification if your friends deactivate accounts or become inactive for prolonged periods of time

3- There is no warning if your friends account is showing abnormal increases in friend counts

4- A lot of my friends on the list have way more than 150 friends just like me. 

5- Never got to the actual reason why I started doing this.. which was to see what % of my friends post political stuff. That count is still 8/318 but there is no easy way to classify the posts on an excel file and put a code next to it and pareto it!  Out of almost 200 most recent posts in my feed, 50 were political and they came from 8 people.. They all seem to have posts on their pets, yoga, family which always seems to be anywhere between 50-70% of their posts. If there was a select way to mute that, I would be a happier person. 

The real question is "Am I seeing all their posts?" or "is FB only showing me select posts from these people that are political?" or "are these people deliberately posting this only to me and a select group?"

No way to tell. 

Majority of the posts are travel realated or family photos and pets. For that, I will gladly keep reviewing accounts periodically, clean up stuff and go explain to people why there is no point on being "friends" on FB when I don't get to see what they look like after 5 years but keep getting memes and political forwards for years. 

I am just having data withdrawal symptoms.. there is a lull at work and Christmas/New Year is coming.. next I will go look at my Yoga class graphs and charts.. Thankfully, that dataset was generated by me and is very accurate!

Another year of yoga

2014 saw me do three (or two depending on who you ask) things

1. Travel a lot for work and figure out ways to cope with that schedule wise

2. Do yoga whenever possible while home and figure out ways to adjust that into the schedule

3. Do the usual things at home when possible (San would give me a D- for that this year.. the kids might give me a B- given they are partial to me)

Travel for work is not a topic for this blog till I start my next gig whenever that might be. The usual things at home do get a blog post or two with a lot less frequency.. that leaves Yoga!

This is an engineer trying to summarize yoga stats. So this post has to have some graphs and charts!

As usual the goal was to try and do Bikram Yoga at least 200 times this calendar year and yet again, I fell short of that goal. Yoga is a process and one gets the benefit as long as one tries in all sincerity. So from that standpoint, will give myself an A+

Can honestly tell myself that I went to the Yoga room at every possible opportunity this year. Given my travel days, the 50% attendance this year is like a 80+ % attendance. It was better than last year.. (just realized that the graph for last year was overwritten by mistake).

For those math geeks, the reason for the double lines is that on some days I did two classes and that messes up the graph.. 

This year it was 181 classes since Jan 5th.  Last year it was 194.. Next year.. again the goal is to go 200 times.. It may be time to find hotels close to Bikram Yoga studios in my travel locations. 

Now for the weight tracking..

Started off flat. After the India trip the weight that was added on seems to have stayed permanently! Either that or the weighing machine had some midway calibration issue when we came back from India and we replaced the battery. It is now holding steady at 149+/-1 lbs when last year it was 143+/-1 lbs for the most part. 

Going to keep collecting this data. Someday someone who decides to do research in Bikram Yoga and weight stability might use this data! 

This year, there was one special "posture clinic" class that I got to attend in October. When I walked into the studio that say and saw that there were only five people who had shown up for that special 2 hour class with the head teacher at BYSJ, was expecting to have the class cancelled. Michelle showed up inspite of her busy schedule organizing the California Yoga Championship and spent more than the alloted 2 hours teaching the five of us little things to remember that improved our postures. 

Something she said that day stuck with me. She said "look at yourself in the mirror. You might not like everything you see there. Some of you look conflicted all the time. It is time to let go of things that you don't like and improve on the things you like when you stare at yourself!"

Today I went for the last class of 2014. Looked at myself in the mirror and saw two people. There is a nice do-gooder spiritual guy on the one side fighting a vice presidential asshole on the other. One of them has to go or a better compromise has to be reached. 

There is also the guy who is happy to just be in the room giving his 110% who has to reconcile with the guy who is perpetually unhappy with falling down, losing the breath or have a symetry mismatch.

Sharing two pictures taken by Jr. this year. (It is good to take pictures of yourself every now and then to see little details)

This is my favorite pose. It takes me all my will power to do this pose knowing that within a few seconds we are all going to be flat on the floor. Can only raise by body clear off my right toe. On the left toe, it is not perceptible. 

The other pose that has frustrated me this year is the Camel pose. Have fallen forward and almost hit the ground more than 10 times this year. Something has to be fixed somewhere. 

Jr. snapped three photos of me doing Camel pose from three different angles. This is a collage of those three shots. The symmetry is off. Something that you cannot realize while doing the pose because you think you are doing it right when reality is far off..

The good thing is that there is no deadline to get any of this to perfection as it is a moving target. It is a "process" and "eventually" this body will find the right balance. 

My FIL asked me last week "Sundar, you are going on all these hikes. Has the yoga helped make things easier? Are you feeling younger?"

My sincere answer was "I am growing older and my body is dealing with that. Yoga is maintaining a status quo! It is not helping me get younger.. but it is helping me not feel older. It is relative!"

Not saying this will work for everyone or this is easy. It has worked and continues to work for me. Maybe it is a good match for my personality and somehow improving on the same routine day after day is something that I can accept as a challenge while others cannot. Maybe the SPC charting guy in me with a manufacturing quality mindset is a perfect match for Bikram Yoga. It is possible.. 

but work, it did! 

Thankful that there is a Yoga studio within 10 minutes from home which stays true to the original Bikram Yoga where a guy like me can still get continued encouragement from teachers and fellow students!

Here's to 2015 and the continuation of the "process"!

Wishing all of you a wonderful 2015. May the next year bring you all that you desire that you know in your heart is actually good for you!

Focusing your mind - Bikram Yoga followup

This is a followup to the previous post which described physical changes after starting Bikram Yoga.

Before trying to describe the Behavioral changes over the last 6 weeks (Yes, it has been 6 weeks and so far we have made it to 40/43 days!), there are a few important physical changes that were left out in the previous post.

- Softening and shinier skin. With all that sweating your skin becomes extremely soft like a baby's skin. It also starts reflecting light. Your nose, forehead etc. reflect flash when photographed. The front part of your leg where the skin stretches over the bone also starts to get shiny.

- Hair loss (if you can call it that) in select areas of the body. Inner thighs, the inside of your arms near the elbows, the calf area, the few hairs on your chest all gone. There are a lot of guys who show up to class who are as hairy as they get, but just letting you know that for someone who did not have much body hair to start with this is was a good thing... and yes, your chest reflects a lot more light than before when flash photographed.

- Phenomenal ability to shut your ears from the inside. Well, guess all married men acquire this ability to filter out select sounds from the wife, kids, MIL over time, but this is like magic. You can stop listening to things without ear plugs! Like a switch. Needless to say the four women in the house are all upset with Daddy's new found skill.

There was also one day when I slowed down in class after the first 20 minutes when the towel turned a bright yellow where my sweat pooled on it. Having been through Jaundice in 5th grade was worried about having done something to my liver and started doing one set instead of two throughout the rest of the class. The teacher told me that it is normal for some folks to sweat yellow and to drink more water. Later internet searching showed that this is a reaction to the urea from the sweat (same urea from urine gets out through sweat) to some of the new bio-degradable laundry detergents. As it so happened we brought a new "eco" detergent from Costco two days back and it is not a concern anymore.

Now that we have all that documented for other people who might look for information, here is the part about the mind.

The first few days of Yoga was spent in coping with the body changes. It also came with guilt for not having treated the body nicely all this time since the accident, for abusing it with a lot of 14-18 hour work days, bad food choices etc. etc. Then there were thoughts of "why didn't I do this before. This place is so close to home" and some internal justification that it was not meant to be then and it is meant to be now.

After the first week, there was a total sense of detachment with "high decibel noise". When the kids or wife spoke, daddy listened. When they raised their voice, it was filtered out. Same thing at work in meetings where folks got all hyper. Invariably, you realize that when it gets to that point at work or home, filtering out does not change anything. The people who scream don't accomplish anything anyways and only when they calm down themselves do we get to a solution. The only times in the last six weeks this control was not exercisable was when someone lied and my face and ears turned red because blood rushed to my face. Most of this may be commonsense and things regular people do all the time, but it is a new experience for me.

For a person who was always "hyperactive" and quick to get excited over technical things, this is a big change. In other words my signal to noise has gone up by orders of magnitude. This is perceived by people around me as "operating at a higher level", "separating the wheat from the chaff" etc. etc.

Right now, the reaction to anything that is touted as a major problem is "okay, think. what next". There is a deep breath that is being taken before making any serious decision or before opening ones mouth in meetings or at home. Sometimes it is better to leave things unsaid and when you take that breath you realize it and stop yourself.

Controlling your anger is more difficult when you start yoga. The first week was tough. It was like you became a women and were going through PMS. There was a lot of frustration, anger, and happiness. Was really emotional. This went away after the first week.

This change might be perceived by some as a "he doesn't care anymore" or "is he going to quit?" or sometimes your kids might make statements to your wife like "daddy doesn't listen to me anymore" and your wife might think you are going to leave the house and go to the mountains. You walk away from situations where you would have stood and fought and the other person just goes "what happened? you don't want a fight?", "you not man enough?"..

Have realized that this aloofness is not a good thing right now at this stage of life, especially in light of the man enough part, and have corrected it in places.

Now for a sensitive topic. Internet sites, "Bikram quotes" from people who are writing negative articles about him, say that your drive to do things in bed is supposed to increase with yoga and this is something to brag about. On the contrary, the first two weeks after doing yoga, that was the last thing on my mind. All those pretty people you see in the studio and nothing stirs inside you. You go to Santa Cruz and there are good looking women frolicking in the beach and you don't get excited in any way.

Skimpy clad women are not new to me, even from ballroom dancing days. There it was all about blocking out that from your mind and focusing on the dancing. Here the issue seems to be that there is nothing to block. You expect your brain to work on blocking out a thought but it is like the thought didn't arise in the first place. Again, this is a personal experience and maybe something is different with me. If you tried yoga and went through the same or similar experience, please do drop a note in the comment box. There is not much out there in terms of experience from a guy's perspective. Probably guys are not outspoken when it comes to this topic and guess most guys would not want to talk about this, leave alone blog about this.

Have to admit that I have tried to think about this a little too long. Was this a reflection of how doing things in bed were in the past some way to feel alive or feel good about yourself and now that Yoga makes you feel good, you are okay with all that taking a backseat? Or is it the fact that sleeping earlier and focusing on your breathing taking priority over everything else? It is likely that the sleeping hours before the wife comes to bed and leaving hours before she gets up is the root cause and not some mind thing. Hence the request for others to share their comments. You might be perceived as self centered and selfish by your family if you went through similar things. Guys don't play "hard to get", girls do. So when a guy is perceived that way, something has definitely changed.

One theory (self analysis of course) is that even for a guy, there is a lot of hormone changes possibly going on what with compressing parts of the body and extending them and having blood flow to parts that have not seen such flows in ages. Maybe a side effect of those hormone changes? If you are touching your own forearm and go "wow.. this is smoother than my wife's hand" then maybe you have an issue. Even had a weird dream of me becoming like Lord Shiva in his ArdhaNarishvara form (half of his body is man and the other half is Parvathi).

Internet searches tell me that yoga by default reduces chemicals produced by body in stress situations (cortisol). It also stimulates all the glands in the body. From day 10 to day 30, could not care less about anything. Over the last ten days with some experimenting and self analysis, have come to the conclusion that :

- nothing wrong with me physically
- nothing wrong psychologically with respect to being turned on either but you have to willingly turn on a switch in your head and make it say you want it
- somehow the default setting for sensuality is turned off and you have to turn it on at will

So there again, if you feel your drive is gone and you don't seem be bothered by it, it may not be gone. It is very much there if you chose to go for it.

Having had no training as a doctor or a yogi and not having much data go with from the internet, this is the best I could do to summarize the last part. Yoga is supposed to make you realize that the "you" or "my" is not worth it. Guess you get there through a process where you first realize what the "you" is all about.

Recently the body and mind seem to have reached a steady state and the changes are not drastic. They are all gradual changes in strength, flexibility and the ability to focus or defocus on things and ideas. There is no more weight loss either. It has plateaued out.

Not going to add more posts on Yoga. If anything, will update these two posts or add things to the comment section. The real goal was to put these things out so that other folks looking for info. will at least see one persons perspective and add more data to their decision making process on continuing with Hot Yoga.

Life, just got interesting!

.

Tolearati

That should be a legal word in the dictionary.

We have gliterrati, technorati, etc. so why not? and maybe it should mean "a collective body of people who live and let live"!

In case you are wondering why the request for some data, some things have been bothering me, what with the gloomy weather outside and the blog reading from the last few days.

For example, transporation! A guy who writes a "travelogue" ought to be concerned about the fate of transportation the world over, right?

We have governments monopoly on road building, public transportation, transportation routes, who makes what modes of transport at what cost, the control over the transportation modes on this world economy and environment, not to mention downright apathy on the part of governmnets the world over to provide what the common man needs to navigate today's world!

(all this after reading PK and Sauvik posts within a week and an NPR piece of who is going to be transportation secretary for the USA in the new Obama administration and how he may have a tough time balancing things)

Another example is the hoopla over Valentines day, the fact that it is Saint Valentines day and therefore is a Christian thing, how therefore it is something that Indians should not celebrate, how holding hands in public or kissing is not an "Indian" thing to do, how women going to pubs is against hinduvta, the concept of "hinduvta", how liberal is liberal, how fundamentalist is fundamentalist, how secular is secular, how free is free, how pink is pink, etc. Okay, maybe that last one wasn't on my mind as much as the other questions.

Finally, the last thing that we see is a flood of articles from the Huffington post to the Tehran times and anyone else claiming to provide news, on "India launches cola made from Cow Urine". When do a few folks doing something represent a country or its people in the world. Does the western media know that a majority of the Indian population is endorsing "Gau Jal"?, is there an official press release from the Government of India stating this cola as a product of the government, somehow this is linked to policy, etc.? Similar things happen to countries and people (USA is an equally prime example) where a few people do something and the entire country is supposed to be behind it!

Obviously before some of these thoughts get cleared, there were even more simple questions like what consitutes a minority, why would a majority of people divide themselves and be so polarized over things that happen to a minority of people the world over, within countries, states, why the divisions of what makes the minorities be important in the first place, what are the odds of finding a left handed lesbian pub and god loving woman in Bangalore, etc. etc. Okay, strike that last one out. It was more of an afterhought!

This post cannot continue folks! The brain needs to slow down and work off of some real data to see if all the above questions can be explained statitstically or we just have to resort to grandma sayings, aesops fables and Jataka tales. Maybe this cannot be explained in simple terms and one just has to accept it for what it is.

So, we wait for data and a deeper understanding of what drives all the insanity in this world!

.