making backup better

Yesterday we looked at backing up our production databases to cloud storage. One of the main motivations behind doing this was cost. We were able to reduce the cost of storage from $3K/TB capex plus $300/TB/year opex to $400/TB/year opex. This is a great solution but some customers complain that it is not generic enough and latency to cloud storage is not that great. Today we are going to address both of these issues with the cloud storage appliance. First, let’s address both of the typical customer complaints.

The database backup cloud service is just that. It backs up a database. It does it really well and it does it efficiently. You replace one of the backup library modules that translates writes of backup data to the cloud REST api rather than a tape driver. The software works well with commercial products like Symantec or Legato and integrates well into that solution. Unfortunately, the critics are right. The database backup cloud service does that and only that. It backs up Oracle databases. It does not backup MySQL, SQL Server, DB2, or other databases. It is a single use tool. A very useful single use tool but a single use tool. We need to figure out how to make it more generic and backup more than just databases. It would be nice if we could have it backup home directories, email servers, virtual machines, and other stuff that is used in the data center.

The second complaint is latency. If we are writing to an SSD or spinning disk attached to a server via high speed SCSI, iSCSI, or SAS, we should expect 10ms access time or less. If we are writing to a server half way across the country we might experience 80ms latency. This means that a typical read or write takes eight times longer when we read and write cloud storage. For some applications this is not an issue. For others this latency makes the system unusable. We need to figure out how to read adn write at 10ms latency but leverage the expandability of the cloud storage and lower cost.

Enter stage left the Oracle Cloud Storage Appliance. The appliance is a software component that listens on the data center internet using the NFS protocol and talks to the cloud services using the storage REST api. Local disks are used as a cache front end to store data that is written to and read from the network shares exposed by the appliance. These directories map directly to containers in the Oracle Storage Cloud Service and can be clear text or encrypted when stored. Data written from network servers is accepted and released quickly as it is written to local disk and slow tricked to the cloud storage. As the cache fills up, data is aged and migrated from the cache storage into cloud storage. The metadata representing the directory structure and storage location is updated to show that the data is no longer stored locally but stored in the cloud. If a read occurs from the file system, the meta data helps the appliance locate where the data is stored and it is presented to the network client from the cache or pulled from the cloud storage and temporarily stored in the local cache as long as there is space. A block diagram of this architecture is shown below

The concept of how to use this device is simple. We create a container in our cloud storage and we attach to it with the cloud storage appliance. This attachment is exposed via an nfs mount to clients on our corporate network and anyone on the client can read or write files in the cloud storage. Operations happen at local disk speed using the network security of the local network and group/owner rights in the directory structure. It looks, smells, and feels just like nfs storage that we would spend thousands of dollars per TB to own and operate.

For the rest of this blog we are going to go through the installation steps on how to configure the appliance. The minimum requirements for the appliance are

  • Linux 7 (3.10 kernel or later)
  • Docker 1.6.1 or later
  • two dual core x86 CPUs
  • 4 GB of RAM

We will be installing our configuration on a Windows desktop running VirtualBox. We will not go through the installation of Oracle Enterprise Linux 7 because we covered this a long time ago. We do need to configure the OS to have 4 GB of RAM and at least 2 virtual cores as shown in the images below.




We also need to configure a network. We configure two networks. One is for the local desktop console and the other is for the public internet. We could configure a third interface to represent our storage network but for simplicity we only configure two.


We can boot our Linux 7 system and will need to select the 3.10 kernel. By default it will want to boot to the 3.8 kernel which will cause problems in how the appliance works.

What we would like to do is remove the 3.8 kernel from our installation. This is done by removing the packages with the rpm -e command. We then update the grub.cfg file to list only the 3.10 kernels.


Once we have removed the kernels, we update the grub loader and enable additional options for the yum update.



The next step that we need to take is to install docker. This is done with the yum install command.


Once we have the docker package installed, we need to make sure that we have the nfs-client and nfs-server installed and started.



It is important to note that the tar bundle is not generally available. It does require product manager approval to get a copy of the software for installation. The file that I got was labeled oscsa-1.0.5.tar.gz. I had to unzup and untar this file after loading it on my Linux VirtualBox instance. I did not do a screen capture of the download but did go through the installation process.





We start the service with the oscsa command. When we start it it brings up a management web page so that we can make the connection to the cloud storage service. To see this page we need to start firefox and connect to the page.


One of the things that we need to know is the end point of our storage. We can find this by looking at the management console for our cloud services. If we click on the storage cloud service details link we can find it.


Once we have the end point we will need to enter this into the management console of the appliance as well as the cloud credentials.


We can add encryption and a container name for our network share and start reading and writing.


We can verify that everything is working from our desktop by mounting the nfs share or by using cloudberry to examine our cloud storage containers. In this example we use cloudberry just like we did when we looked at the generic Oracle Storage Cloud Services.



We can examine the properties of the container and network share from the management console. We can look at activity and resources available for the caching.

In summary, we looked at a solution to two problems offered by our database backup solution. The first was single purpose and the second was latency. By providing a network share to the data center we can not only backup or Oracle database but all of the databases by having the backup software write to the network share. We can backup other files like virtual machines, email boxes, and home directories. Disk latency operates at the speed of the local disk rather than the speed of the cloud storage. This software does not cost anything additional and can be installed on any virtual platform that supports Linux 7 with kernel 3.10 or greater. When we compare this to the Amazon Storage Gateway which requires 2x the processing power and $125/month to operate it looks significantly better. We did not compare it to the Azure solution because it is an iSCSI hardware solution and not easy to get a copy of for testing.

171 thoughts on “making backup better”

  1. Thank you for all your valuable work on this site. My mom take interest in managing internet research and it’s easy to see why. Many of us learn all regarding the dynamic way you give worthwhile strategies through this web blog and as well cause contribution from the others on that content then our own child is in fact understanding a lot. Have fun with the rest of the new year. Your carrying out a powerful job.

  2. I precisely needed to appreciate you again. I’m not certain what I could possibly have achieved in the absence of the type of recommendations revealed by you concerning such question. It was actually a very depressing scenario in my opinion, however , considering a new professional style you resolved it took me to leap for gladness. I’m just grateful for this information as well as hope that you recognize what a great job you have been putting in instructing the others via a web site. More than likely you’ve never come across any of us.

  3. I simply wanted to write a small note to thank you for some of the remarkable items you are writing on this website. My time-consuming internet lookup has now been compensated with reputable facts to share with my best friends. I would assume that many of us website visitors are undeniably endowed to exist in a fine network with very many lovely people with very helpful tricks. I feel very happy to have come across the web page and look forward to many more entertaining moments reading here. Thanks once again for a lot of things.

  4. I wish to show appreciation to the writer just for bailing me out of such a crisis. Right after exploring through the world wide web and coming across proposals that were not productive, I was thinking my entire life was done. Being alive devoid of the solutions to the issues you have sorted out all through your report is a serious case, and ones that might have badly damaged my career if I had not discovered your site. Your primary knowledge and kindness in touching almost everything was valuable. I don’t know what I would have done if I had not come upon such a thing like this. I can also now look ahead to my future. Thank you so much for your expert and sensible help. I will not be reluctant to refer the website to any individual who ought to have direction on this problem.

  5. I have to show my thanks to this writer for bailing me out of this challenge. Right after checking throughout the the net and obtaining ideas which were not pleasant, I thought my entire life was done. Existing without the approaches to the problems you have fixed by way of your main short post is a critical case, and the kind which might have badly affected my entire career if I hadn’t come across your site. That expertise and kindness in maneuvering the whole thing was useful. I am not sure what I would’ve done if I hadn’t discovered such a stuff like this. I’m able to now look forward to my future. Thanks for your time very much for your skilled and amazing help. I won’t think twice to propose your web site to anyone who needs and wants direction about this subject.

  6. My wife and i got now more than happy when Peter managed to finish up his preliminary research through the entire precious recommendations he received through your web site. It’s not at all simplistic to just choose to be giving freely tips which other people have been making money from. And we also see we need the writer to appreciate for this. Most of the explanations you’ve made, the straightforward blog navigation, the relationships you will make it possible to instill – it is mostly remarkable, and it’s helping our son in addition to us understand the matter is entertaining, and that is wonderfully mandatory. Thanks for everything!

  7. I want to show my thanks to the writer for bailing me out of such a problem. As a result of searching through the world wide web and seeing methods which are not pleasant, I believed my life was done. Being alive devoid of the answers to the difficulties you have resolved as a result of your good short post is a serious case, as well as ones which might have badly damaged my career if I had not discovered your site. Your good training and kindness in maneuvering all the details was invaluable. I am not sure what I would’ve done if I had not come across such a stuff like this. I can also at this time relish my future. Thanks for your time very much for this specialized and results-oriented guide. I will not be reluctant to suggest your blog post to anyone who would like guidelines about this issue.

  8. I definitely wanted to construct a small remark so as to say thanks to you for those wonderful guidelines you are writing here. My extended internet search has at the end of the day been honored with good details to share with my two friends. I would tell you that we visitors actually are very much lucky to dwell in a fabulous website with many lovely individuals with very beneficial principles. I feel really privileged to have used the web site and look forward to really more fabulous times reading here. Thanks again for a lot of things.

  9. I intended to create you this little bit of remark to be able to say thank you yet again for the lovely advice you’ve discussed in this article. It has been shockingly generous of you to allow unhampered all that many of us might have advertised as an ebook to help with making some profit on their own, chiefly since you might have tried it if you ever desired. Those thoughts as well acted to become a good way to comprehend someone else have the identical interest similar to my own to grasp more and more with reference to this problem. Certainly there are millions of more pleasant opportunities up front for those who find out your blog post.

  10. I just wanted to post a comment so as to appreciate you for the nice ideas you are writing here. My time intensive internet look up has finally been compensated with wonderful facts to talk about with my colleagues. I ‘d assert that we visitors are very lucky to exist in a decent network with very many awesome people with great points. I feel quite happy to have come across your entire web page and look forward to many more pleasurable moments reading here. Thank you again for all the details.

  11. I really wanted to write down a brief comment in order to say thanks to you for some of the wonderful facts you are sharing here. My prolonged internet look up has at the end been rewarded with reasonable facts to talk about with my best friends. I ‘d state that that we site visitors are very much fortunate to dwell in a great network with very many awesome people with good tips and hints. I feel really lucky to have discovered your entire site and look forward to many more awesome moments reading here. Thanks a lot once more for everything.

  12. I am commenting to make you be aware of of the helpful encounter my wife’s child undergone reading your webblog. She noticed several things, including what it is like to have a marvelous teaching spirit to have the rest with ease comprehend specified tortuous things. You really exceeded people’s desires. Many thanks for giving these valuable, trustworthy, explanatory as well as cool guidance on your topic to Mary.

  13. I simply wished to thank you very much once again. I do not know the things I would’ve sorted out without the type of smart ideas documented by you regarding such question. Certainly was a very frustrating condition in my circumstances, nevertheless witnessing this specialised style you processed the issue forced me to weep for joy. I’m just happier for this information and thus believe you really know what a powerful job you are carrying out teaching people today using your blog. I know that you haven’t encountered all of us.

  14. I wanted to create you a very small word just to thank you very much as before over the exceptional advice you have featured here. This is pretty generous of you giving unreservedly precisely what a lot of people would’ve offered for an electronic book to generate some cash for themselves, and in particular considering that you could have done it in case you desired. The principles in addition worked like the good way to understand that other people online have the identical zeal just like my own to understand great deal more regarding this issue. I believe there are several more pleasurable times ahead for many who take a look at your site.

  15. I wish to convey my respect for your generosity for those people that really need help with this niche. Your real dedication to getting the solution across turned out to be definitely significant and has specifically allowed many people just like me to realize their targets. Your amazing invaluable facts entails a great deal to me and somewhat more to my office workers. Thanks a ton; from each one of us.

  16. I must show my appreciation to you just for bailing me out of this particular problem. Because of surfing around through the world-wide-web and meeting tips that were not powerful, I was thinking my life was gone. Living without the answers to the issues you’ve resolved all through the review is a crucial case, and those which may have badly affected my career if I hadn’t encountered your blog. Your ability and kindness in handling a lot of stuff was tremendous. I’m not sure what I would’ve done if I hadn’t come across such a subject like this. I’m able to now look ahead to my future. Thank you very much for this professional and results-oriented help. I will not be reluctant to refer your web blog to any individual who will need support about this matter.

  17. I not to mention my pals were taking note of the great thoughts on your web blog and so the sudden I had a horrible feeling I had not thanked the blog owner for those secrets. Most of the people were for that reason warmed to study them and now have seriously been taking pleasure in those things. Appreciate your turning out to be considerably helpful and for deciding upon such decent themes millions of individuals are really desperate to learn about. My personal sincere regret for not expressing gratitude to you earlier.

  18. I simply desired to thank you very much all over again. I’m not certain the things I might have tried in the absence of the entire suggestions shown by you on this subject matter. It had become a horrifying condition in my position, however , finding out this specialised approach you solved it took me to leap with gladness. I am just happy for this assistance as well as have high hopes you recognize what a powerful job you are always providing instructing men and women through the use of a blog. Most probably you have never encountered all of us.

  19. I am only writing to let you know of the notable encounter my wife’s daughter went through studying your web page. She came to find too many pieces, including what it is like to have an amazing teaching mood to get men and women quite simply grasp some complex subject matter. You actually exceeded visitors’ expectations. Many thanks for churning out such valuable, dependable, edifying and also fun tips about this topic to Emily.

  20. I precisely wanted to thank you very much once more. I am not sure what I would have followed in the absence of these tricks provided by you over such a topic. It was a troublesome scenario in my opinion, but seeing the very skilled fashion you handled that forced me to weep with happiness. Now i am grateful for the work and thus have high hopes you find out what a great job that you’re getting into training people via a site. I’m certain you have never met all of us.

  21. I simply wanted to jot down a message to express gratitude to you for these awesome ways you are placing at this site. My time-consuming internet research has now been recognized with sensible suggestions to write about with my friends and classmates. I would point out that most of us readers actually are really endowed to exist in a fabulous website with so many wonderful individuals with great hints. I feel very much fortunate to have seen your entire webpages and look forward to some more cool times reading here. Thanks again for all the details.

  22. I would like to point out my love for your kind-heartedness for people that really need help on in this subject. Your special dedication to passing the solution all-around had become pretty helpful and has consistently encouraged workers just like me to arrive at their desired goals. Your warm and friendly useful information can mean a great deal to me and extremely more to my mates. With thanks; from all of us.

  23. I want to show appreciation to you for rescuing me from this particular predicament. Because of checking throughout the search engines and meeting strategies that were not powerful, I thought my life was well over. Being alive minus the answers to the problems you’ve resolved by way of this guideline is a critical case, and those that might have badly damaged my entire career if I hadn’t come across your web site. Your good natural talent and kindness in taking care of the whole lot was important. I am not sure what I would have done if I had not come upon such a point like this. I can at this point look forward to my future. Thank you so much for this professional and results-oriented guide. I won’t hesitate to recommend your web site to any person who needs counselling on this subject matter.

  24. My wife and i were now relieved that John managed to finish off his research through the ideas he acquired out of your web page. It’s not at all simplistic to simply possibly be giving away techniques men and women have been making money from. So we figure out we now have the blog owner to be grateful to for this. The most important illustrations you made, the easy blog navigation, the friendships your site help to foster – it is all unbelievable, and it’s leading our son in addition to our family do think that topic is enjoyable, which is seriously indispensable. Thank you for the whole thing!

  25. I intended to compose you that little word to help give thanks again regarding the fantastic tactics you’ve featured in this case. It is really seriously generous of people like you to grant without restraint what exactly many of us could possibly have supplied as an ebook to get some dough for themselves, most importantly now that you could have done it if you decided. Those strategies also served to become a easy way to know that other people online have the same desire just as my personal own to know significantly more around this problem. I know there are thousands of more pleasurable instances up front for folks who find out your site.

  26. I in addition to my pals ended up looking through the best things from the blog then quickly I had a horrible suspicion I never thanked the website owner for those tips. Those ladies are actually consequently passionate to read through all of them and already have in actuality been loving them. Appreciation for being considerably thoughtful and then for obtaining variety of helpful issues most people are really needing to know about. My very own honest apologies for not expressing appreciation to earlier.

  27. I precisely desired to appreciate you once more. I’m not certain what I could possibly have accomplished in the absence of the tricks documented by you concerning such topic. It had been the challenging situation in my view, but being able to view a expert fashion you solved it made me to jump over gladness. I am just grateful for this help and trust you are aware of a powerful job you are accomplishing educating the others by way of your web blog. I am certain you haven’t come across all of us.

  28. I am just writing to make you understand what a magnificent experience my cousin’s princess obtained using the blog. She discovered too many details, including what it is like to have an awesome teaching mood to have many people quite simply master chosen advanced subject matter. You actually did more than visitors’ expectations. Thanks for displaying the warm and friendly, trusted, informative as well as cool guidance on that topic to Gloria.

  29. Thank you a lot for providing individuals with an exceptionally pleasant possiblity to check tips from this site. It really is so kind and as well , stuffed with a lot of fun for me and my office friends to visit your site at a minimum 3 times in 7 days to read through the latest stuff you have. And definitely, I am just always impressed concerning the outstanding methods you serve. Some 3 points in this posting are unquestionably the best we have all had.

  30. My spouse and i ended up being quite more than happy that Raymond managed to deal with his studies from the precious recommendations he made when using the web page. It is now and again perplexing just to possibly be releasing tips and tricks that other folks may have been selling. And we do understand we now have the writer to be grateful to for this. These illustrations you’ve made, the easy website menu, the friendships you give support to foster – it’s got all sensational, and it’s really leading our son in addition to our family understand the idea is exciting, which is particularly vital. Thanks for all!

  31. I am only writing to make you understand what a extraordinary encounter my girl obtained reading yuor web blog. She learned too many details, including what it is like to possess an excellent coaching spirit to have the rest without hassle completely grasp specified complicated topics. You really did more than people’s expectations. Many thanks for giving these necessary, safe, educational not to mention unique tips on this topic to Evelyn.

  32. Thank you for each of your labor on this site. Debby enjoys working on internet research and it’s simple to grasp why. All of us know all about the dynamic method you produce worthwhile tips and tricks via the website and as well as encourage participation from the others on the point so our favorite child is without question discovering a lot of things. Take advantage of the rest of the new year. You’re the one performing a dazzling job.

  33. Thanks for all of your hard work on this blog. Kim delights in doing research and it is easy to understand why. Many of us learn all about the dynamic way you render effective steps via the web blog and even welcome contribution from some others on that concern plus our simple princess is actually becoming educated so much. Take pleasure in the remaining portion of the year. Your doing a dazzling job.

  34. I must show some appreciation to the writer for rescuing me from such a difficulty. Just after exploring through the search engines and seeing thoughts which were not powerful, I was thinking my life was over. Living without the presence of answers to the issues you’ve resolved as a result of this short article is a critical case, and the kind that might have adversely damaged my entire career if I hadn’t noticed your blog post. Your own mastery and kindness in maneuvering everything was important. I don’t know what I would’ve done if I had not come across such a point like this. I am able to at this time look forward to my future. Thanks a lot very much for your impressive and amazing help. I will not think twice to suggest your site to anyone who should receive guidance on this matter.

  35. Thank you a lot for providing individuals with a very memorable possiblity to check tips from this website. It is often so pleasant and as well , full of fun for me personally and my office peers to search your blog at a minimum 3 times in a week to see the latest items you have got. And lastly, I am just always impressed with your cool inspiring ideas you give. Certain 2 tips in this post are definitely the best I’ve ever had.

  36. I’m writing to let you be aware of what a fine discovery my cousin’s child obtained visiting your site. She noticed a good number of pieces, including what it’s like to have a very effective coaching spirit to make a number of people completely comprehend certain tricky matters. You truly surpassed readers’ expectations. Thank you for coming up with the powerful, healthy, edifying and fun thoughts on the topic to Kate.

  37. I simply desired to thank you so much once again. I am not sure the things I would have sorted out in the absence of these thoughts discussed by you directly on my industry. This was a real traumatic concern in my circumstances, however , spending time with the skilled manner you processed that forced me to jump with joy. I am grateful for the work as well as have high hopes you realize what a great job you are undertaking educating people thru your blog. I’m certain you’ve never come across all of us.

  38. My husband and i ended up being quite happy when Jordan could conclude his reports out of the precious recommendations he grabbed in your web pages. It is now and again perplexing just to possibly be giving away procedures which other folks may have been making money from. And now we know we need the website owner to be grateful to for this. The main explanations you’ve made, the straightforward site menu, the friendships you help instill – it’s got many incredible, and it’s really letting our son and our family reckon that that subject matter is interesting, and that’s tremendously vital. Thanks for everything!

  39. I simply wished to say thanks all over again. I’m not certain the things I would have handled in the absence of the solutions shown by you directly on such a situation. It actually was the hard dilemma in my view, however , encountering the very professional fashion you solved it forced me to weep with contentment. I’m just grateful for your assistance and expect you recognize what a great job you are always undertaking teaching many others by way of your webblog. I am sure you’ve never met any of us.

  40. Thanks for all your work on this site. Betty delights in going through internet research and it’s obvious why. A lot of people hear all about the lively mode you produce vital tips and tricks through your web site and improve contribution from others on the idea and our favorite child has been discovering a lot. Enjoy the remaining portion of the year. You’re the one performing a remarkable job.

Leave a Reply

Your email address will not be published. Required fields are marked *