Just decided to combine all the useless posts
4-2-15
2 redis classes online
2 centos AWS servers -- should get a third. Need to convert install scripts. Setup fail2ban
signed up for hadoop course thing. There are a few of them. Might as well get it over with.
headset/mic in phone now I can call from computer, much easier. I have a minipad I can still do conferencing with.
started python project on ramsey and DAD
Looking at method to separate read/write with redis and to use redis with mongo since mysql just takes up too much ram. Maybe at home I can do it, but I need to setup my third laptop, but it has windows on it which is required for mongo certification --- remote exam and stuff. That sucks.
-------------------------------
4-6-2015
busy busy busy
Taking pivotal course on redis.
Finished 3rd class on redit from udemy over the weekend. Very very good. I highly recommend "Redis" from udemy. The others are useless.
Hopefully I can do more programming for ramsey, DAD, and get redis into DAD as well (basically a one second ttl when getting data in case everybody tries to beat up a server to get data).
4-7-2015
Finished pivotal redis course, got certficate, granted its online.
Such a bum for not getting more done.
4-9-2015
Hadoop is understandable, but a big project from the Mapr classes. They will take a long time to do. I won't want it to be endless -- but its good. Need some practice first. Will take some easy free classes at udemy for an hour a day while I work on other stuff.
4-13-2015
1. Singed up for puppet certification for end of month. After dealing with OPS and a person who could never seem to help because he was too distracted and only into himself, I don't want to rely on someone. I want to know if it is so easy that it can be done, and why not.
2. Finished personal crap, but more to do.
3. Need to finish that stupid hadoop course --- with mongodb and puppet certification exams, hadoop will just be casually studied with easy online sources. Exam will have to wait.
4. Still waiting on getting DAD setup with redis (on myself).
Its funny how some people are so into themselves they learn technologies so that they have job security but they are not really that great at it, but since they are the only person you can rely on, they get away with murder.
4-14-2015
Starting puppet training course. https://www.udemy.com/learning-puppet/?dtcode=NBTtnMS2K1qq
Follow this first: https://www.howtoforge.com/puppet-ubuntu-14.04
which then I have an exam to take a Person Vue for this, and I don't care if I fail the first time. You know what they are asking and can study for it. Often a whole book or course contains lots of useless information and you don't know what is important.
I don't recommend "Basic overview of Big Data Hadoop" as it was hard to follow. Giving Hadoop a little break because I was to get certified in puppet, Mongodb, and PostgreSQL first.
To me, OPS people take control of your life by running Nagios, Thruk, Graphite, Grafana, and puppet and you can't get anything done because they are too busy. In addition, some people take it on themselves to be experts in those areas and they suck but nobody knows they suck because their boss doesn't know it and he is an idiot. No this isn't about any friend I have (not you who is an expert at quality control). Its about an overworked idiot who specialized in stuff his boss (who couldn't even program) knew nothing about and acted like he was special. The best way to defend against selfish political people is to be able to do what they do so you can show them up. Their lies and stupidity come to a halt. I had a guy who always had to win. I agreed with him 50% of the time, he never agreed with me. He was good most of the time, but sometimes he was incredibly stupid. His boss wasn't any better. Good most of the time, but sometimes just short sighted and dumb. You have to be independent to show people reality sometimes. Its good not to be arrogant or to show you are really better, but plant the idea in their heads and let them take all the credit. They are politicians or demented anyways.
4-16-2015
Puppet uses Ruby for modules. Didn't know that. That explains why our guy made it such a huge pain in the butt to add anything needed for MySQL. He should have told us --- projects were unnecessarily delayed if he would have explained the situation so get more resources. That. Still, his fault. His fault for not telling us that so he could keep control because then I would have helped --- maybe --- I converted from Perl to Python and never looked back, and Ruby is too much like Perl.
Will still get Puppet certification, but for my computers I will have them running salt.
So in order of certification: Puppet, MongoDB, PostgreSQL, Hadoop. Maybe Cassandra afterwards. During this time, using salt, DAD, graphite grafana, etc.
4-17-2015
I am beginning to realize how immature and crude our setup potentially was with puppet. My theory about centralized configuration might have been correct and it should have been done different. This puppet course is very good, clear, and east to understand. The trick is I watch a little everyday to it doesn't overload the brain.
I am going to go with salt anyways, after getting certified by puppet, hopefully if not the end of this month, the end of next month.
But, I will leave 3 mysql servers in puppet, and 3 hadoop/other systems in salt for my setup --- just so I am forced to deal with them and keep up to date.
4-20-2015
Living in the dark. Its amazing how much you can learn from getting certified. The certification is not the important part, the learning of various subjects for fun is. Get certified in stuff you like cause its easy to get side tracked.
DAD + Mongo (with MMS, ops manager, and salt) and also MaxDB, all with graphite and grafana, and predictive resource growth, is the way to go.
I am very impressed with MongoDB 3.0 and the direction its going.
Its do funny, but it is so easy to get lost in a fast paced company, you can't see the forest for the trees. Especially with a narrow-minded, unable to program, political, crocodile smiling ex-boss who makes weird ass decisions.
4-22-2015
Immediate:
1. Mongodb 3.0 with ops manager --- use ops manager to create mongodb services.
2. Redis + Mongodb --- just setup.
3. MongoDB certification -- take test next week (study now)
4. Test mnongodb failures from 2.2. Adding server, removing, etc.
5. Test document level transactions. Create a way to undo stuff in a trasnsaction if ti fails.
6. Test a 3rd mongodb server that is all in ram. Compare queries to it and 2nd server. Maybe 4 servers: Master Secondary, Secondary arbiter, add a 4th all memory server that cannot become master (hidden I guess)? Write up an article on this.
7. Test push button upgrade in OPS that is doesn't disconnect or ruin trasnsactions.
other: MAXdb in front of mariadb galera. Remove percona or just use other 3 servers.
The highest is to get one certification out of the way, mongodb 3.0. Need to get certifications out of the way so I can work on DAD, grafana, etc.
6-3-2015
Didn't know google has dns servers you can use.
The ones for my provider at home seems to have slow DNS. Might use it.
https://developers.google.com/speed/public-dns/docs/using
No comments:
Post a Comment