Hi,spark-phoenix integration would be great as Spark community is greately active now and moreand more developers are using Apache Spark.Thanks,Sun.
This is great, Sun! Thank you so much. Would you mind posting this on our user list in response to Siddharth's email? I think other Phoenix users would find it interesting as well.On a side note, not sure how general what you developed is, but it would be interesting to pursue a general Spark integration in Phoenix as an open source contribution.Thanks,JamesOn Tue, Jan 6, 2015 at 5:41 PM, firstname.lastname@example.org <email@example.com> wrote:Hi, James & SiddharthGlad to share our experience of using Phoenix in Production. I believe that Siddharth had donesufficient tests and practices about Phoenix performance. Here are some tips about how we are usingPhoenix for our projects:1. We facilitate Phoenix to give convinience for both RD and QA engineers, as they are glad to usestandard sql to operate hbase with no much loss of query performance.2. In Production environment, we mainly integrate Apache Spark with Phoenix to optimize data loading toPhoenix tables with or withour secondary indexes. Glad that current performance of writing had workedsmoothly with both compared to previously used MySQL InfoBright and other sql schema. We both had testeda lot for secondary indexes and query optimization for Phoenix before moving Phoenix to Productionenvironment. Now we can get most of the features worked for Phoenix in our job.3. Challenges had a lot too, such as bulkload performance with wal enabled, query optimization, statistical data collection with Phoenixfull table scan, and so on. However, we believe Phoenix be a sufficient schema for sql query over HBase and we are gladthat even more our projects are considering using Phoenix.Thanks,Sun.
Hi Sun,Any experiences you can share with Siddharth?Thanks,James---------- Forwarded message ----------
From: Siddharth Ubale <firstname.lastname@example.org>
Date: Thu, Jan 1, 2015 at 11:21 PM
Subject: Phoenix in production
To: "email@example.com" <firstname.lastname@example.org>
We are seriously thinking of phoenix in Production environment , however, we have no much data of how Phoenix is behaving in production.
Can anyone let us know if anyone is using Phoenix in Production and any challenges which they have experienced.
#43, Velankani Tech Park, Block No. II,
3rd Floor, Electronic City Phase I,
Bangalore – 560 100
Tel : +91 80 3202 4060
we innovate, plan, execute, and transform the business